-- Logs begin at Thu 2022-05-12 19:24:06 UTC, end at Thu 2022-05-12 21:29:48 UTC. -- May 12 20:28:43.575017 dv-cinder-815659-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 20:28:43.584413 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 20:28:43 2022] *** May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: nodename: dv-cinder-815659-7-iscsi May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: machine: x86_64 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: clock source: unix May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: pcre jit disabled May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: detected number of CPU cores: 4 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: current working directory: / May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: detected binary path: /usr/bin/uwsgi-core May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: your processes number limit is 47680 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: your memory page size is 4096 bytes May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: detected max file descriptor number: 2048 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: lock engine: pthread robust mutexes May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: thunder lock: enabled May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 20:28:43.587637 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 20:28:43.631240 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: Python main interpreter initialized at 0x56454a1969c0 May 12 20:28:43.631240 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: python threads support enabled May 12 20:28:43.631240 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: your server socket listen backlog is limited to 100 connections May 12 20:28:43.631240 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: your mercy for graceful operations on workers is 90 seconds May 12 20:28:43.631611 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: mapped 403077 bytes (393 KB) for 2 cores May 12 20:28:43.631698 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: *** Operational MODE: preforking *** May 12 20:28:43.631904 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: *** uWSGI is running in multiple interpreter mode *** May 12 20:28:43.631904 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: spawned uWSGI master process (pid: 103370) May 12 20:28:43.632106 dv-cinder-815659-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 20:28:43.637299 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: spawned uWSGI worker 1 (pid: 103371, cores: 1) May 12 20:28:43.637299 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: spawned uWSGI worker 2 (pid: 103372, cores: 1) May 12 20:28:43.637299 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 20:28:44.894710 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 20:28:44.937679 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 20:28:45.724961 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:28:45.724961 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: from cryptography.utils import int_from_bytes May 12 20:28:45.725383 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:28:45.725383 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: from cryptography.utils import int_from_bytes May 12 20:28:45.740938 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:28:45.740938 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: from cryptography.utils import int_from_bytes May 12 20:28:45.741265 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:28:45.741265 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: from cryptography.utils import int_from_bytes May 12 20:28:48.426587 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:28:48.427252 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:28:48.427654 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:28:48.428031 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:28:48.428297 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:28:48.428698 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.429031 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.429378 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.429706 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.430042 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.430359 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.430688 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.431014 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.431349 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.431617 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.432482 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.432784 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-7-iscsi {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.433113 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.433457 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.433777 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.434100 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.434411 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.434738 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.435047 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.435546 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.435993 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.436307 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.436623 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.436965 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.437307 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.437619 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.437958 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.438257 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.438591 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.438905 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.439314 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-7-iscsi {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.439626 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.439944 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.440262 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.440685 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.440998 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.441333 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.441663 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.441992 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.442307 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.442678 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.443012 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.443476 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.443806 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.444113 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.444425 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.444740 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.445063 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.445395 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.445707 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.445963 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.446275 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.446604 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.446939 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.447259 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.447517 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.447770 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.448094 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.448423 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.448736 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.449048 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.449381 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.449695 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.450007 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.450315 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.450626 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.450936 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.451261 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.451583 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.451906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.452219 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.452543 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.452947 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.453203 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.453539 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.453884 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.454208 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.454519 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.454840 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.455163 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.455474 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.455786 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.456096 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.456422 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.456751 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.457060 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.457379 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.457660 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.457969 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.458365 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.458783 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.459163 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.459490 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.459837 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.460195 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.460536 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.460929 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.461242 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.461580 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.461893 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.462915 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.462915 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.462915 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.463397 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.463480 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.463785 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.464096 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.464408 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.464718 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.465045 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.465389 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.466668 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:28:48.468727 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:28:48.468829 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.468829 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.468981 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:28:48.469060 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.469211 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:28:48.469368 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.469512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:28:48.469512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.469512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.469808 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.469942 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470027 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470167 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470253 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470378 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470461 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470586 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470684 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470766 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470898 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.470983 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471109 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471195 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471328 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471423 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471588 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471728 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471859 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.471951 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-7-iscsi {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.472236 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.472566 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.472879 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.473196 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.473530 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.473853 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.474888 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.475022 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.477612 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.477745 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.477847 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.477945 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478028 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478117 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478198 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478277 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478365 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478447 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478447 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478659 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478659 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.478805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.479185 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-7-iscsi {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.479413 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.479716 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.479871 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480029 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480191 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480370 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480556 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480691 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.480866 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.481057 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.481193 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.481429 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.481580 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.481791 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.481928 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.482113 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.482232 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.482438 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.482529 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.482756 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.482845 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.483074 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.483171 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.483393 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.483488 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.483693 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.483781 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.483999 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.484096 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.484309 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.484403 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.484625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.484713 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.484930 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.485028 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.485233 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.485365 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.485510 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.485622 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.485819 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.485964 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.486140 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.486294 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.486460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.486622 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.486786 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.486949 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.487037 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.487270 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.487359 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.487586 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.487675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.487907 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.487997 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.488215 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.488303 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.488521 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.488625 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.488830 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.488930 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.489132 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.489220 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.489461 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.489655 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.490645 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.490842 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.491023 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.491230 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.491417 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.491588 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.491752 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.491937 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.492199 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.492392 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.492568 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.492757 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.492932 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.493106 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.493321 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.493516 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.493701 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.493873 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.494057 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.494231 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.494406 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.494596 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.494780 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.494955 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.495138 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.495314 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.495500 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.495677 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.495850 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.496034 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.496222 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.496222 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.496585 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.496776 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.496951 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.497124 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.497317 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.497506 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.497694 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.497867 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.498050 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.498223 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.498399 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.498572 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.498765 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.498940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.499111 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.499537 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.499716 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.499899 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.500072 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.500283 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.500469 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.500642 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.500815 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.500998 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.501171 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.501378 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.501557 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.501727 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.501909 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.502096 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.502375 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.502554 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.502729 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.502901 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.503083 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.503274 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.503274 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.503612 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.503799 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.503963 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.504125 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.504293 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.504468 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.504672 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.504862 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.505049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.505266 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.505482 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.505658 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.505834 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.506018 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.506212 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.506387 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.506573 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.506760 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.506937 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.507110 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.507294 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.507468 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.507656 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.507842 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.508017 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.508190 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.508368 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.508620 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.508620 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.508973 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.509137 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.509296 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.509426 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.509561 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.509695 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.509872 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.510006 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.510132 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.510258 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.510410 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.510596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.510781 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.510957 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.511141 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.511314 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.511499 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.511673 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.511844 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512016 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.512187 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512389 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.512666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.512666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.513495 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.513675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.513855 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.514027 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.514197 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.514378 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.514663 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.514847 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.515019 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.515205 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.515393 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.515578 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.515776 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.515969 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.516110 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.516238 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.516371 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.516515 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.516689 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.516826 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.516966 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:28:48.517102 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.517322 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.517517 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.517694 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.517869 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518041 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518213 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518386 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518583 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518756 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.518940 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519130 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519314 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519485 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.519675 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.520483 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.520665 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.520838 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521008 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521179 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521422 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521613 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521785 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.521971 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.522157 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.522340 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.522527 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.522834 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.522968 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523102 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523229 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523397 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523665 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523793 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.523941 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524128 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524303 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524482 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524667 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524667 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.524983 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.525154 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.525343 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.525534 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.525720 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.525893 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526064 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526243 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526428 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526428 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526428 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526428 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.526428 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.527240 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.527410 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.527591 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.527771 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.527953 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.528124 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.528294 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.528472 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.528663 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.528863 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529051 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529236 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529511 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529670 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529787 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.529912 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530047 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530207 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530341 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530477 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530611 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530786 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.530962 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531137 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531309 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531493 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531667 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531837 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.531837 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.532153 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.532322 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.532506 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.532669 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.532857 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533116 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533314 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533487 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533487 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533487 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.533487 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.534151 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.534335 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.534517 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.534699 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.534868 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535037 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535217 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535397 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535397 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535770 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.535956 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.536141 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.536336 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.536995 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.537173 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.537376 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.537548 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.537715 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.537715 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538006 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538141 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538268 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538402 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538527 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538527 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538787 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.538787 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539033 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539033 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539277 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539401 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539534 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539660 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539792 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.539917 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540048 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540048 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540302 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540428 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540553 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540677 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540808 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.540933 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541066 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541348 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541475 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541599 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541740 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541867 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.541991 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542115 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542229 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542351 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542485 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542610 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542725 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542848 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.542971 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543116 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543320 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543451 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543577 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543702 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543828 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.543952 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544087 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544222 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544351 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544477 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544603 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544808 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.544936 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545062 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545194 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545353 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545482 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545619 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545745 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.545885 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546047 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546173 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546297 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546297 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546541 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546666 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546791 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.546915 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547039 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547172 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547422 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547546 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547671 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547809 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.547935 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548059 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548184 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548308 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548444 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548578 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548718 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548857 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.548983 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549107 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549231 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549390 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549529 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549656 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549781 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.549906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550030 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550153 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550286 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550412 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550537 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550668 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550795 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.550920 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551052 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551184 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551310 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551434 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551566 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551691 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551824 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.551950 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.552665 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.552947 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553187 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553357 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553487 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553613 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553738 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553863 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.553990 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554124 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554256 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554383 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554637 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554762 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.554896 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555024 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555149 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555274 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555399 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555524 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555667 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555793 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.555919 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556046 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556171 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556305 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556432 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556557 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556682 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556808 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.556933 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557072 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557199 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557340 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557592 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557718 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557856 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.557985 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558111 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558237 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558363 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558489 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558624 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558751 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.558876 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559002 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559128 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559264 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559391 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559517 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559642 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559767 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.559893 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560031 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560159 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560292 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560419 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560545 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560678 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560814 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.560948 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561075 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561200 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561379 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561507 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561650 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561778 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.561904 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562036 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562162 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562296 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562425 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562551 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562677 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562802 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.562928 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563062 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563190 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563315 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563442 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563599 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563731 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.563908 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564046 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564213 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564344 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564519 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564656 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564827 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.564958 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565138 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565268 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565475 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565620 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565782 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.565911 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566082 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566211 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566391 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566530 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566696 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566826 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.566997 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.567128 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.567297 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.567442 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.567605 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.567916 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568053 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568274 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568512 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568723 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568862 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.568990 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569124 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569322 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569471 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569622 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569753 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.569926 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570057 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570246 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570385 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570554 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570685 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570856 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.570995 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571159 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571461 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571591 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571799 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.571931 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572108 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572248 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572410 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572547 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572722 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.572854 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573028 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573157 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573358 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573488 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573671 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573814 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.573979 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574110 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574286 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574416 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574602 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574732 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.574913 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575044 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575218 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575348 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575529 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575663 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575835 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.575967 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576141 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576279 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576447 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576578 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576761 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.576890 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577065 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577200 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577397 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577544 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577705 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.577852 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578007 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578138 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578313 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578452 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578628 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578759 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.578956 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579194 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579325 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579522 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579653 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579833 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.579973 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580151 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580282 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580467 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580606 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580783 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.580914 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581101 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581240 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581438 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581568 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581755 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.581883 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582068 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582206 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582377 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582506 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582681 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582810 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.582984 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.583112 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.583339 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.583478 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.583663 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.583791 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584062 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584240 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584379 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584515 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584642 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584769 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.584894 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585020 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585206 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585366 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585547 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585678 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.585859 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586004 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586175 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586305 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586477 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586609 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586786 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.586926 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587087 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587218 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587406 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587537 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587711 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.587854 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588011 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588142 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588312 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588442 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588611 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588751 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.588949 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589080 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589250 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589426 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589607 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589747 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.589932 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590069 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590268 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590405 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590572 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590704 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.590874 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591012 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591193 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591324 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591495 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591627 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591794 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.591933 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592092 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592223 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592398 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592529 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592704 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.592834 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593002 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593134 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593329 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593464 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593639 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593771 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.593947 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594087 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594252 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594383 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594553 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594683 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.594860 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595102 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595234 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595420 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595550 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595733 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.595873 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596041 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596179 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596339 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596476 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596643 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596783 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.596949 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597080 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597249 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597419 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597576 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597727 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597868 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.597998 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.598174 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.598305 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.598475 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.598614 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.598773 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.599423 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.599666 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.599812 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.599982 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600127 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600301 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600430 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600563 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600690 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.600877 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601008 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601185 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601350 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601515 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601658 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601819 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.601950 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602126 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602257 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602428 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602581 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.602890 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603020 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603199 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603330 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603513 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603652 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603822 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.603944 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604131 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604262 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604456 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604587 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604768 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.604898 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605066 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605202 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605400 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605532 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605688 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605827 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.605990 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606121 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606290 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606424 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606592 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606723 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.606894 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607025 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607214 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607346 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607520 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607650 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607822 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.607961 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608124 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608255 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608423 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608555 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608756 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.608894 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609056 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609196 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609383 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609515 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609695 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.609835 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610003 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610133 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610320 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610449 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610627 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610767 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.610935 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611065 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611245 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611384 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611546 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611678 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611857 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.611995 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612164 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612295 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612474 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612613 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612774 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.612904 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613073 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613209 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613416 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613556 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613724 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.613862 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.614031 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.614167 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.614350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.614504 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.615287 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.615482 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.615637 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.615784 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.615922 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616072 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616213 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616383 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616514 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616692 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.616830 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617002 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617147 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617322 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617453 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617631 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617763 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.617940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618079 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618250 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618390 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618562 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618693 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.618872 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619013 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619182 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619320 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619487 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619617 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619796 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.619937 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620103 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620226 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620407 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620547 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620730 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.620861 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621039 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621177 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621364 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621514 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621674 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621812 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.621977 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622110 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622286 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622427 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622589 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622721 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.622907 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623043 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623227 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623372 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623544 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623681 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623862 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.623993 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.624175 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.624564 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.624737 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.624874 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625051 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625182 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625374 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625503 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625682 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.625921 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626099 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626254 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626399 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626574 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626706 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.626890 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627029 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627209 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627354 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627524 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627663 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627839 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.627970 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628156 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628305 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628456 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628592 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628758 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.628895 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629059 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629191 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629400 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629534 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629704 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.629891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630034 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630180 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630478 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630608 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630811 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.630968 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631129 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631261 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631448 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631581 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631770 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.631910 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632132 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632266 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632450 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632582 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632761 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.632901 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633076 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633207 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633416 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633549 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633726 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.633864 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634033 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634165 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634346 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634476 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634665 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634803 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.634973 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635105 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635283 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635414 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635585 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635714 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.635889 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636037 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636203 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636332 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636511 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636642 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636829 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.636960 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637163 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637323 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637503 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637635 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637820 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.637951 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638141 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638282 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638470 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638667 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638797 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.638985 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639117 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639322 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639453 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639639 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639769 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.639940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640081 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640259 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640390 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640560 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640690 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.640868 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641009 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641175 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641344 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641508 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641640 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641809 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.641949 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642111 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642249 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642418 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642555 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642716 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.642920 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643049 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643334 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643473 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643651 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643790 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.643960 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644089 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644261 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644504 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644644 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644863 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.644994 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.645161 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.645315 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.645491 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.645636 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.646366 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.646579 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.646711 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.646838 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.646965 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647101 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647229 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647357 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647555 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647686 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.647882 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648021 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648329 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648506 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648642 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648815 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.648947 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649123 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649253 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649462 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649592 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649774 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.649912 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650075 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650206 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650378 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650510 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650713 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650841 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.650968 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651092 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651264 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651405 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651567 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651697 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.651874 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652006 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652177 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652319 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652479 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652611 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652781 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.652911 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653086 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653229 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653414 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653548 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653729 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.653858 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654036 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654182 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654339 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654462 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654641 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654771 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.654941 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655072 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655247 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655376 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655560 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655692 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.655899 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656028 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656216 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656346 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656521 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656656 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656828 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.656959 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657139 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657269 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657473 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657604 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657787 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.657917 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658097 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658235 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658407 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658546 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658723 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.658855 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659035 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659172 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659347 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659580 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659711 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.659915 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660045 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660238 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660382 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660548 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660685 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660862 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.660994 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.661190 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662012 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662178 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662344 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662475 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662658 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662824 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.662965 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663145 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663276 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663463 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663595 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663779 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.663911 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664095 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664226 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664410 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664533 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664735 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.664876 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665041 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665181 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665402 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665531 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665670 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665805 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.665982 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666112 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666294 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666426 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666609 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666740 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.666921 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667050 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667232 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667364 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667543 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667682 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.667880 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668010 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668195 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668335 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668498 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668636 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668806 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.668937 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669117 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669262 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669461 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669593 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669772 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.669914 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670079 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670219 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670521 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670699 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.670830 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671004 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671133 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671309 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671440 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671618 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671748 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.671926 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672065 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672246 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672377 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672575 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672706 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.672892 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673023 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673201 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673350 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673540 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673683 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.673857 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674057 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674216 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674369 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674524 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674681 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674868 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.674999 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675203 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675421 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675554 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675692 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675819 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.675952 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676117 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676249 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676425 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676556 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676788 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.676927 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.677141 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.677305 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.677475 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.677608 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.677902 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678032 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678213 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678352 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678529 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678667 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.678974 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679138 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679280 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679575 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679751 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.679883 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680065 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680271 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680401 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680616 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680754 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.680933 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681065 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681251 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681433 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681562 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681694 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.681868 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682000 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682181 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682320 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682487 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682611 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682792 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.682923 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683094 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683224 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683400 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683538 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683706 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.683845 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684008 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684141 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684317 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684456 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684627 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684757 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.684937 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685042 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685237 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685349 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685579 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685686 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685882 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.685980 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686205 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686304 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686612 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686815 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.686906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687120 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687210 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687428 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687526 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687732 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.687822 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688035 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688125 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688338 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688439 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688640 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688729 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.688948 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689037 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689250 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689360 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689579 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689668 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689879 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.689968 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690188 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690280 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690491 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690580 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690798 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.690897 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691138 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691236 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691458 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691547 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691761 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.691859 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692063 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692153 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692377 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692467 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692731 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.692843 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693103 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693538 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693766 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.693864 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.694090 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.694194 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.694418 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.694520 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.694755 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695028 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695138 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695306 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695397 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695631 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695730 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.695965 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696054 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696296 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696385 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696602 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696702 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696907 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.696997 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697212 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697348 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697562 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697655 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697875 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.697964 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.698186 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.698275 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:28:48.698494 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.698803 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.699111 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.699417 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.699725 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.700031 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.700337 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.700644 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.700950 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.701257 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.701660 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.701999 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.702318 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.702635 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.702954 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.703267 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.703581 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.704037 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.704346 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.704658 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.704972 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.705326 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.705647 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.705949 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.706370 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.706682 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.707000 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.707316 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.707625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.707940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.708811 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.709130 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.709478 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.709788 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.710114 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.710447 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.710773 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.711094 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.711397 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.711698 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.711999 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.712306 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.712620 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.712927 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.713226 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.713552 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.713859 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.714159 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.714461 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.714760 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.715060 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.715366 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.715666 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.715965 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.716270 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.717384 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.717384 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.717384 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.717631 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.717780 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.718086 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.718387 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.718689 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.718989 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.719453 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.719790 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.720109 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.720432 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.720742 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.721062 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.721396 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.721727 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.722036 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.722183 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_db.sqlalchemy.engines [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.722348 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.722649 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.723070 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.723281 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.723588 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.724011 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.724949 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.725169 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.725579 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.725912 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.726244 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.726552 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.726878 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.727194 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.727515 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.727832 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.728139 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.728465 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.728774 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.729086 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.729425 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.729738 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.730064 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.730365 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.730679 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.731006 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.731330 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.731664 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.731991 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.732341 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.732651 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.732992 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.733339 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.733655 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.733966 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.734269 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:28:48.734512 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:28:48.758284 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_db.sqlalchemy.engines [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.788068 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.context [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9fde6af-dc03-4b65-925d-792b71d3bae1(cell1) {{(pid=103371) load_cells /opt/stack/nova/nova/context.py:464}} May 12 20:28:48.792394 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:28:48.794030 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:28:48.794821 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:28:48.796743 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:28:48.809130 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_db.sqlalchemy.engines [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.812070 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_db.sqlalchemy.engines [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.823180 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.context [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9fde6af-dc03-4b65-925d-792b71d3bae1(cell1) {{(pid=103372) load_cells /opt/stack/nova/nova/context.py:464}} May 12 20:28:48.827667 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_concurrency.lockutils [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:28:48.829314 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_concurrency.lockutils [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:28:48.830175 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_concurrency.lockutils [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:28:48.832388 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_concurrency.lockutils [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:28:48.846558 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_db.sqlalchemy.engines [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.850578 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_db.sqlalchemy.engines [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:48.985160 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_db.sqlalchemy.engines [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:49.018916 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG oslo_db.sqlalchemy.engines [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:28:49.389474 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: WARNING keystonemiddleware.auth_token [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:28:49.398274 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: WARNING keystonemiddleware.auth_token [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:28:49.426586 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: WARNING keystonemiddleware.auth_token [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:28:49.434782 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: WARNING keystonemiddleware.auth_token [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:28:49.749049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: WARNING keystonemiddleware.auth_token [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:28:49.756050 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: WARNING keystonemiddleware.auth_token [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:28:49.762321 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56454a1969c0 pid: 103371 (default app) May 12 20:28:49.764404 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:28:49.765621 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 May 12 20:28:49.766025 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Thu May 12 20:28:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:28:49.782143 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: WARNING keystonemiddleware.auth_token [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:28:49.788482 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: WARNING keystonemiddleware.auth_token [None req-147b2c70-5338-4271-8d6d-df876c2321bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:28:49.794717 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56454a1969c0 pid: 103372 (default app) May 12 20:30:13.944912 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:13.946150 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 May 12 20:30:13.946764 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:14.383179 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-d8d19246-ff9f-4511-88bb-4d06c11082a9 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:14.413661 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-d8d19246-ff9f-4511-88bb-4d06c11082a9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.460190 May 12 20:30:14.414304 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Thu May 12 20:30:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:30:16.705287 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:16.706402 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-b54ad671-da30-4720-8ab8-f6e9399b1cb9 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 12 20:30:16.706788 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:16.771870 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-2a54ee9c-ce96-4b83-8a31-7087551d4e7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:16.793804 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:30:16.793804 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: warnings.warn(msg) May 12 20:30:16.894729 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-2a54ee9c-ce96-4b83-8a31-7087551d4e7c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.182118 May 12 20:30:16.895693 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:17.116311 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-6ba4532c-9ec6-47db-a2ef-0399fe19bb64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:17.118620 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:30:17.118620 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:30:17.257604 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-6ba4532c-9ec6-47db-a2ef-0399fe19bb64 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353928 May 12 20:30:17.258459 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Thu May 12 20:30:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:19.633179 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-2a54ee9c-ce96-4b83-8a31-7087551d4e7c admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:19.634234 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-2a54ee9c-ce96-4b83-8a31-7087551d4e7c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 12 20:30:19.634634 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:19.740975 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-7d7ec92c-67c7-48ce-85e6-772c76ad7c38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:19.759140 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:30:19.759140 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:30:19.869299 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-7d7ec92c-67c7-48ce-85e6-772c76ad7c38 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.228693 May 12 20:30:19.870446 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:19.882628 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-8228af79-7840-424c-a8ef-68324a89bf29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:19.884111 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:30:19.884111 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: warnings.warn(msg) May 12 20:30:19.991596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-8228af79-7840-424c-a8ef-68324a89bf29 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112419 May 12 20:30:19.992839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Thu May 12 20:30:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:22.332083 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-7d7ec92c-67c7-48ce-85e6-772c76ad7c38 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:22.333767 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-7d7ec92c-67c7-48ce-85e6-772c76ad7c38 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 May 12 20:30:22.334389 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:22.402638 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-198acd94-b012-4a0e-968e-901a68abe699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:22.483302 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-198acd94-b012-4a0e-968e-901a68abe699 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142052 May 12 20:30:22.484109 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:22.498545 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-c8172913-b31d-43c5-9ced-94a39c42b35c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:22.590217 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-c8172913-b31d-43c5-9ced-94a39c42b35c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096263 May 12 20:30:22.591054 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Thu May 12 20:30:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:30:24.916631 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-198acd94-b012-4a0e-968e-901a68abe699 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:24.921033 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-198acd94-b012-4a0e-968e-901a68abe699 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004815 May 12 20:30:24.921524 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:24.987786 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-fe7dac7d-d872-4665-ac85-9a626d7bc579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:25.055631 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-fe7dac7d-d872-4665-ac85-9a626d7bc579 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127205 May 12 20:30:25.056579 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:25.069124 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-7f27a03a-975c-4ff0-9a9e-67ddc82c1704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:25.189375 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-7f27a03a-975c-4ff0-9a9e-67ddc82c1704 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123966 May 12 20:30:25.190138 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Thu May 12 20:30:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:30:27.489923 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-fe7dac7d-d872-4665-ac85-9a626d7bc579 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:27.490871 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-fe7dac7d-d872-4665-ac85-9a626d7bc579 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 12 20:30:27.491268 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:27.567521 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:27.662210 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165048 May 12 20:30:27.672243 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:27.677413 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-f02c739b-84ba-46fb-8c3a-b6bf9e8e8c6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:27.762250 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-f02c739b-84ba-46fb-8c3a-b6bf9e8e8c6a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090139 May 12 20:30:27.763252 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Thu May 12 20:30:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:30.144483 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:30.148054 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 May 12 20:30:30.149007 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:30.220077 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-a4e4a15c-6e24-49ea-8682-f0ddbc91f3ed admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:30.246785 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-a4e4a15c-6e24-49ea-8682-f0ddbc91f3ed admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091501 May 12 20:30:30.253354 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Thu May 12 20:30:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:30:32.635246 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:32.636358 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-76ec8e60-e16b-4127-adba-db71abd402a7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 12 20:30:32.636807 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:32.701380 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-ed3f3b91-d63c-4762-a166-b0c1d21e682a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:32.792638 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-ed3f3b91-d63c-4762-a166-b0c1d21e682a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.149746 May 12 20:30:32.793413 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 20:30:32.809821 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-5a1f10b3-087f-4db3-989c-a2541bc2f21c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:32.916838 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-5a1f10b3-087f-4db3-989c-a2541bc2f21c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114357 May 12 20:30:32.917713 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Thu May 12 20:30:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:30:35.305684 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-ed3f3b91-d63c-4762-a166-b0c1d21e682a admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:35.306720 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-ed3f3b91-d63c-4762-a166-b0c1d21e682a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 12 20:30:35.307147 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:35.379923 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-1804a403-3a74-46c9-9703-5373b6cdbf6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:35.512703 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-1804a403-3a74-46c9-9703-5373b6cdbf6c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.199119 May 12 20:30:35.513542 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:35.526449 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-5fc8b680-8646-4a97-874d-d5e554f23a85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:35.613205 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-5fc8b680-8646-4a97-874d-d5e554f23a85 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091422 May 12 20:30:35.614024 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Thu May 12 20:30:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:38.194464 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-1804a403-3a74-46c9-9703-5373b6cdbf6c admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:38.195481 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-1804a403-3a74-46c9-9703-5373b6cdbf6c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 May 12 20:30:38.195941 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:38.259049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-1ec10361-d4c0-4700-86e9-6909c7c52489 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:38.351961 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-1ec10361-d4c0-4700-86e9-6909c7c52489 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.149915 May 12 20:30:38.352532 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 20:30:38.365256 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-a9ef7c9a-b461-4550-a7c2-b0c47602a865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:38.526265 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-a9ef7c9a-b461-4550-a7c2-b0c47602a865 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165398 May 12 20:30:38.526855 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Thu May 12 20:30:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:40.808061 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-1ec10361-d4c0-4700-86e9-6909c7c52489 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:40.809493 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-1ec10361-d4c0-4700-86e9-6909c7c52489 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 May 12 20:30:40.810003 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:40.871934 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-dbfc301d-e811-49fe-ba85-8bee4d592680 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:40.992088 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-dbfc301d-e811-49fe-ba85-8bee4d592680 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.174982 May 12 20:30:40.996185 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:41.004872 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-b8135aeb-5d20-4ae1-862b-0fd68dee75f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:41.131986 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-b8135aeb-5d20-4ae1-862b-0fd68dee75f7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130700 May 12 20:30:41.132576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Thu May 12 20:30:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:30:43.463359 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-dbfc301d-e811-49fe-ba85-8bee4d592680 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:30:43.464371 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-dbfc301d-e811-49fe-ba85-8bee4d592680 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 20:30:43.464774 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:30:43.527368 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "disk": 160}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:43.633221 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.162568 May 12 20:30:43.633820 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Thu May 12 20:30:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:30:43.645653 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-10879b2e-916e-4405-add9-acbd9232eb2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:30:43.738699 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-10879b2e-916e-4405-add9-acbd9232eb2c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096873 May 12 20:30:43.739411 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Thu May 12 20:30:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:31:09.048774 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:09.049809 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 May 12 20:31:09.050201 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:09.107344 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-6fa5ff45-0343-4f97-b3de-85719cdd4479 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:09.125480 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-6fa5ff45-0343-4f97-b3de-85719cdd4479 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069106 May 12 20:31:09.125955 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Thu May 12 20:31:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:10.142021 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:10.143015 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-8d035f7a-b186-4e4c-9f1e-b0b906476668 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 12 20:31:10.143429 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:10.352959 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-73ab723d-61bd-4657-a0bc-01f47b1c26dd admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:10.359346 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.wsgi [None req-73ab723d-61bd-4657-a0bc-01f47b1c26dd admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-73ab723d-61bd-4657-a0bc-01f47b1c26dd admin admin] Request method failure captured: May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept: application/json May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept-Encoding: gzip, deflate May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Connection: keep-alive May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Content-Length: 0 May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Host: 10.222.0.59 May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-Api-Version: compute 2.90 May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-System-Scope: None May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: User-Agent: python-novaclient May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Auth-Token: gAAAAABifW6Ogto8fT5nAltbaudcOQkfFNESqMyIE8Gkzv0EzL-VxRYbBxMHkNG6tZG0XJZyzEk4pE1Vk-V0dF7j7ekULOgdxv0RiMUwq_Dsj7WZNSMWiXP94yH7Yp_qBFX_ko3Phiy1NXadGMak90s3c3nkio-lM9fYwO87tkuwE5860gcLrGY May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Id: None May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Name: None May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Identity-Status: Confirmed May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Is-Admin-Project: True May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Id: default May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Name: Default May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Name: admin May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Role: member,reader,admin May 12 20:31:10.362720 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Roles: member,reader,admin May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant: admin May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Name: admin May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User: admin May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Id: default May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Name: Default May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Name: admin May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: method: > May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: exception: Flavor 42 could not be found. May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: action_args: {'id': '42'} May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:10.364390 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:10.365350 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:10.366596 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-73ab723d-61bd-4657-a0bc-01f47b1c26dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:10.367625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-73ab723d-61bd-4657-a0bc-01f47b1c26dd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062471 May 12 20:31:10.367625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Thu May 12 20:31:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 20:31:10.373983 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-ab86efad-0f2d-4e65-8e01-0590027935d0 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:10.396894 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-ab86efad-0f2d-4e65-8e01-0590027935d0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026355 May 12 20:31:10.397415 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:10.418556 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-d886fa19-2cc0-4e27-896e-fa2092b3b270 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:10.439375 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-d886fa19-2cc0-4e27-896e-fa2092b3b270 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024381 May 12 20:31:10.439914 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:10.449260 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-7c48090c-ca1c-4867-a61c-b3c625e66290 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:10.455562 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.wsgi [None req-7c48090c-ca1c-4867-a61c-b3c625e66290 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-7c48090c-ca1c-4867-a61c-b3c625e66290 admin admin] Request method failure captured: May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept: application/json May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept-Encoding: gzip, deflate May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Connection: keep-alive May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Content-Length: 0 May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Host: 10.222.0.59 May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-Api-Version: compute 2.90 May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-System-Scope: None May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: User-Agent: python-novaclient May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Auth-Token: gAAAAABifW6Ogto8fT5nAltbaudcOQkfFNESqMyIE8Gkzv0EzL-VxRYbBxMHkNG6tZG0XJZyzEk4pE1Vk-V0dF7j7ekULOgdxv0RiMUwq_Dsj7WZNSMWiXP94yH7Yp_qBFX_ko3Phiy1NXadGMak90s3c3nkio-lM9fYwO87tkuwE5860gcLrGY May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Id: None May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Name: None May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Identity-Status: Confirmed May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Is-Admin-Project: True May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Id: default May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Name: Default May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Name: admin May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Role: member,reader,admin May 12 20:31:10.458832 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Roles: member,reader,admin May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant: admin May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Name: admin May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User: admin May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Id: default May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Name: Default May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Name: admin May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: method: > May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: exception: Flavor 42 could not be found. May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: action_args: {'id': '42'} May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:10.470906 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:10.471891 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:10.473176 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-7c48090c-ca1c-4867-a61c-b3c625e66290 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:10.474445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-7c48090c-ca1c-4867-a61c-b3c625e66290 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014680 May 12 20:31:10.474445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Thu May 12 20:31:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 20:31:11.350475 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-d886fa19-2cc0-4e27-896e-fa2092b3b270 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:11.351516 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-d886fa19-2cc0-4e27-896e-fa2092b3b270 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 12 20:31:11.351911 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:11.544716 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-120a0871-ffb1-46b5-a4da-9fb527af3c9b admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:11.550319 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.wsgi [None req-120a0871-ffb1-46b5-a4da-9fb527af3c9b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-120a0871-ffb1-46b5-a4da-9fb527af3c9b admin admin] Request method failure captured: May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept: application/json May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept-Encoding: gzip, deflate May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Connection: keep-alive May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Content-Length: 0 May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Host: 10.222.0.59 May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-Api-Version: compute 2.90 May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-System-Scope: None May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: User-Agent: python-novaclient May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Auth-Token: gAAAAABifW6PEQep5MD-AKU6jbr0vJCCfuVeQg_NvJ3TohaqwVdio989C6H57GwexYzqDzdbzUtWPMRIwPWzaTvn19r37FyziBETSHBDfkl83H6ZONM8EQkqaoz0xMDVooG3ygssMq7s-WC8XElurE9w7GYZck63yii5cHxEUZQgBxeBbEahDpQ May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Id: None May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Name: None May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Identity-Status: Confirmed May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Is-Admin-Project: True May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Id: default May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Name: Default May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Name: admin May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Role: member,reader,admin May 12 20:31:11.551836 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Roles: member,reader,admin May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant: admin May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Name: admin May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User: admin May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Id: default May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Name: Default May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Name: admin May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: method: > May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: exception: Flavor 84 could not be found. May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: action_args: {'id': '84'} May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:11.553454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:11.554445 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:11.555576 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-120a0871-ffb1-46b5-a4da-9fb527af3c9b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:11.556598 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-120a0871-ffb1-46b5-a4da-9fb527af3c9b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060935 May 12 20:31:11.556598 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Thu May 12 20:31:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 20:31:11.563649 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-c64ca302-d86c-4db1-a65e-b087294501ec admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:11.577434 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-c64ca302-d86c-4db1-a65e-b087294501ec admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017897 May 12 20:31:11.577968 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:11.588265 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-108f3668-b453-4b1f-909d-ea31ff801282 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:11.601946 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-108f3668-b453-4b1f-909d-ea31ff801282 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017134 May 12 20:31:11.602501 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:11.611608 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-e46b124d-90d3-4629-963f-569e01e4fa1b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:11.616925 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.wsgi [None req-e46b124d-90d3-4629-963f-569e01e4fa1b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-e46b124d-90d3-4629-963f-569e01e4fa1b admin admin] Request method failure captured: May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept: application/json May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept-Encoding: gzip, deflate May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Connection: keep-alive May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Content-Length: 0 May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Host: 10.222.0.59 May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-Api-Version: compute 2.90 May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-System-Scope: None May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: User-Agent: python-novaclient May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Auth-Token: gAAAAABifW6PEQep5MD-AKU6jbr0vJCCfuVeQg_NvJ3TohaqwVdio989C6H57GwexYzqDzdbzUtWPMRIwPWzaTvn19r37FyziBETSHBDfkl83H6ZONM8EQkqaoz0xMDVooG3ygssMq7s-WC8XElurE9w7GYZck63yii5cHxEUZQgBxeBbEahDpQ May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Id: None May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Name: None May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Identity-Status: Confirmed May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Is-Admin-Project: True May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Id: default May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Name: Default May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Name: admin May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Role: member,reader,admin May 12 20:31:11.618460 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Roles: member,reader,admin May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant: admin May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Name: admin May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User: admin May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Id: default May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Name: Default May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Name: admin May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: method: > May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: exception: Flavor 84 could not be found. May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: action_args: {'id': '84'} May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:11.619987 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:11.620940 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:11.622362 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-e46b124d-90d3-4629-963f-569e01e4fa1b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:11.623625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-e46b124d-90d3-4629-963f-569e01e4fa1b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011803 May 12 20:31:11.623625 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Thu May 12 20:31:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 20:31:12.511541 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-108f3668-b453-4b1f-909d-ea31ff801282 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:12.512596 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-108f3668-b453-4b1f-909d-ea31ff801282 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 12 20:31:12.513016 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:12.701247 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-bb3446aa-c021-45f9-8796-0fe7bb4f6245 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:12.707686 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.wsgi [None req-bb3446aa-c021-45f9-8796-0fe7bb4f6245 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-bb3446aa-c021-45f9-8796-0fe7bb4f6245 admin admin] Request method failure captured: May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept: application/json May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Accept-Encoding: gzip, deflate May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Connection: keep-alive May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Content-Length: 0 May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Host: 10.222.0.59 May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-Api-Version: compute 2.90 May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Openstack-System-Scope: None May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: User-Agent: python-novaclient May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Auth-Token: gAAAAABifW6Q-RTgn6n2X9MNAP2rcGI6BmXafIibFGqo7WcEQNds5S3zjOMz8l2DdcJ6RzsIpA9jjzCshZgnGgeEs0H-nRV59t2XkWW7gCRmdK3Vr6mMb-RDB6k2XpD_zpoaWNtm-fKoNp-d7Y3lAdwNg_eM0q370H0ay5g2V-lCdXLLs94jxeI May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Id: None May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Domain-Name: None May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Identity-Status: Confirmed May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Is-Admin-Project: True May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Id: default May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Domain-Name: Default May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Project-Name: admin May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Role: member,reader,admin May 12 20:31:12.709192 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Roles: member,reader,admin May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant: admin May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-Tenant-Name: admin May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User: admin May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Id: default May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Domain-Name: Default May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: X-User-Name: admin May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: method: > May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: exception: Flavor 451 could not be found. May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: action_args: {'id': '451'} May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:12.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:12.711839 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: ERROR nova.api.openstack.wsgi May 12 20:31:12.713189 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-bb3446aa-c021-45f9-8796-0fe7bb4f6245 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:12.714600 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-bb3446aa-c021-45f9-8796-0fe7bb4f6245 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061308 May 12 20:31:12.714600 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:31:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 20:31:12.721069 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-dea6da60-cb85-4ebd-bb51-585681d9574d admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:12.734482 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-dea6da60-cb85-4ebd-bb51-585681d9574d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017475 May 12 20:31:12.736545 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:12.745856 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:12.760080 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017711 May 12 20:31:12.760600 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Thu May 12 20:31:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:31:12.770913 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-4f2a9d78-7225-45c9-aca1-c10f3646c4bf admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:12.776473 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.wsgi [None req-4f2a9d78-7225-45c9-aca1-c10f3646c4bf admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-4f2a9d78-7225-45c9-aca1-c10f3646c4bf admin admin] Request method failure captured: May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept: application/json May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Accept-Encoding: gzip, deflate May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Connection: keep-alive May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Content-Length: 0 May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Host: 10.222.0.59 May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-Api-Version: compute 2.90 May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Openstack-System-Scope: None May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: User-Agent: python-novaclient May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Auth-Token: gAAAAABifW6Q-RTgn6n2X9MNAP2rcGI6BmXafIibFGqo7WcEQNds5S3zjOMz8l2DdcJ6RzsIpA9jjzCshZgnGgeEs0H-nRV59t2XkWW7gCRmdK3Vr6mMb-RDB6k2XpD_zpoaWNtm-fKoNp-d7Y3lAdwNg_eM0q370H0ay5g2V-lCdXLLs94jxeI May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Id: None May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Domain-Name: None May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Identity-Status: Confirmed May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Is-Admin-Project: True May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Openstack-Nova-Api-Version: 2.90 May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Id: default May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Domain-Name: Default May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Project-Name: admin May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Role: member,reader,admin May 12 20:31:12.778049 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Roles: member,reader,admin May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/023813922bcf4863880d01ff0f27548c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_023813922bcf4863880d01ff0f27548c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/023813922bcf4863880d01ff0f27548c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant: admin May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Id: 023813922bcf4863880d01ff0f27548c May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-Tenant-Name: admin May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User: admin May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Id: default May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Domain-Name: Default May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Id: 4a85c2f6540a47cfa927556bdcddaf95 May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: X-User-Name: admin May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: method: > May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: exception: Flavor 451 could not be found. May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: action_args: {'id': '451'} May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:31:12.779530 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:12.780466 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: ERROR nova.api.openstack.wsgi May 12 20:31:12.782550 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-4f2a9d78-7225-45c9-aca1-c10f3646c4bf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:31:12.783944 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-4f2a9d78-7225-45c9-aca1-c10f3646c4bf admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012387 May 12 20:31:12.783944 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:31:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 20:31:13.674495 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:13.675536 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 20:31:13.675929 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:13.869301 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-469a52ca-5932-4394-876e-1231262042ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:31:13.933159 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-469a52ca-5932-4394-876e-1231262042ea admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.116689 May 12 20:31:13.933712 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Thu May 12 20:31:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:31:14.830194 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:14.831219 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 20:31:14.831610 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:15.032879 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-67407e5e-5bd4-48c7-be62-d36ea109f478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:31:15.109268 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-67407e5e-5bd4-48c7-be62-d36ea109f478 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129574 May 12 20:31:15.110454 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Thu May 12 20:31:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:31:16.011411 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:16.012451 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 12 20:31:16.013001 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:16.201124 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-abea2b43-9882-4ef2-bcce-d6694ee52649 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:31:16.263340 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-abea2b43-9882-4ef2-bcce-d6694ee52649 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.113023 May 12 20:31:16.263937 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Thu May 12 20:31:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:31:17.160854 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:17.161897 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 20:31:17.162298 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:17.350781 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-bb2c6d3d-f6b1-43c1-990f-31ce0a280fa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:31:17.441687 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-bb2c6d3d-f6b1-43c1-990f-31ce0a280fa4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.142293 May 12 20:31:17.442181 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Thu May 12 20:31:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:31:18.352557 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:18.353602 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 12 20:31:18.354007 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:31:18.560297 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-2ef8002f-a46a-407d-9643-c14cfd024730 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:31:18.580290 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-2ef8002f-a46a-407d-9643-c14cfd024730 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076126 May 12 20:31:18.580745 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Thu May 12 20:31:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:32:22.131366 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.132315 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-107e5fae-9bf1-455a-8d23-32edf70ae417 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 12 20:32:22.132710 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:32:22.190432 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-d3f2d264-005a-467f-86a0-d6d02774ac65 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.209600 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-d3f2d264-005a-467f-86a0-d6d02774ac65 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070992 May 12 20:32:22.210122 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:32:22.231851 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-33859c24-a545-4e47-9428-5854d648f58b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.239763 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-33859c24-a545-4e47-9428-5854d648f58b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012081 May 12 20:32:22.240285 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:32:22.252015 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-bf8f63f7-9360-4005-b096-96162d4efc0c admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.259481 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-bf8f63f7-9360-4005-b096-96162d4efc0c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011904 May 12 20:32:22.259991 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:32:22.273173 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.280868 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012499 May 12 20:32:22.281414 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:32:22.292527 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-5173d0b5-ce03-4433-99a7-3cb5dae81e2d admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:32:22.300589 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-5173d0b5-ce03-4433-99a7-3cb5dae81e2d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011542 May 12 20:32:22.301088 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Thu May 12 20:32:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:35:54.136232 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:35:54.137257 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 May 12 20:35:54.137675 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:35:54.408518 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:35:54.413298 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:35:54.447233 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-ac6d7d70-437b-4500-a391-2ddadc7c97ee admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156861 May 12 20:35:54.447825 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:35:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:35:55.348065 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:35:55.349079 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 12 20:35:55.349508 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:35:55.540718 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:35:55.541992 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:35:55.541992 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:35:55.543170 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:35:55.543613 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:35:55.544449 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:35:55.544875 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:35:55.563733 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-9ab390ae-47db-4fac-b638-5de9a0fc32d5 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074888 May 12 20:35:55.564205 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:35:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:36:06.888925 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:36:06.889966 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 12 20:36:06.890382 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:36:07.084901 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:36:07.087198 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:36:07.087198 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:36:07.090072 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:36:07.090871 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:36:07.092323 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:36:07.093119 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:36:07.119408 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-d025b0fd-dcd3-479b-83f7-7a14d59ed015 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088398 May 12 20:36:07.119903 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:36:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:36:08.015753 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: DEBUG nova.api.openstack.wsgi [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] Calling method '>' {{(pid=103372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:36:08.016757 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: INFO nova.api.openstack.requestlog [None req-4df8bad0-6ebf-4bf7-8711-9e853548836b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 12 20:36:08.017159 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: [pid: 103372|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Thu May 12 20:36:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:36:08.205475 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG nova.api.openstack.wsgi [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] Calling method '>' {{(pid=103371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:36:08.206640 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 20:36:08.206640 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: warnings.warn(msg) May 12 20:36:08.207840 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:36:08.208293 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:36:08.209112 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:36:08.209556 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: DEBUG oslo_concurrency.lockutils [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:36:08.232010 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: INFO nova.api.openstack.requestlog [None req-1d896a8b-6e86-4d3e-a220-50f73907f675 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078123 May 12 20:36:08.232560 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: [pid: 103371|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Thu May 12 20:36:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:37:05.430355 dv-cinder-815659-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 20:37:05.430934 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: Thu May 12 20:37:05 2022 - graceful shutdown triggered... May 12 20:37:05.431481 dv-cinder-815659-7-iscsi devstack@n-api.service[103371]: Gracefully killing worker 1 (pid: 103371)... May 12 20:37:05.431900 dv-cinder-815659-7-iscsi devstack@n-api.service[103372]: Gracefully killing worker 2 (pid: 103372)... May 12 20:37:06.431799 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: worker 1 buried after 1 seconds May 12 20:37:06.432348 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: worker 2 buried after 1 seconds May 12 20:37:06.432348 dv-cinder-815659-7-iscsi devstack@n-api.service[103370]: goodbye to uWSGI. May 12 20:37:06.433408 dv-cinder-815659-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 20:37:06.433971 dv-cinder-815659-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 20:37:06.437254 dv-cinder-815659-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 20:37:06.452701 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 20:37:06 2022] *** May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: nodename: dv-cinder-815659-7-iscsi May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: machine: x86_64 May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: clock source: unix May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: pcre jit disabled May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: detected number of CPU cores: 4 May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: current working directory: / May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: detected binary path: /usr/bin/uwsgi-core May 12 20:37:06.476971 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: your processes number limit is 47680 May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: your memory page size is 4096 bytes May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: detected max file descriptor number: 2048 May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: lock engine: pthread robust mutexes May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: thunder lock: enabled May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 20:37:06.477851 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 20:37:06.526622 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: Python main interpreter initialized at 0x5651adf769c0 May 12 20:37:06.526622 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: python threads support enabled May 12 20:37:06.526622 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: your server socket listen backlog is limited to 100 connections May 12 20:37:06.526622 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: your mercy for graceful operations on workers is 90 seconds May 12 20:37:06.527096 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: mapped 403077 bytes (393 KB) for 2 cores May 12 20:37:06.527096 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: *** Operational MODE: preforking *** May 12 20:37:06.527351 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: *** uWSGI is running in multiple interpreter mode *** May 12 20:37:06.527351 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: spawned uWSGI master process (pid: 129337) May 12 20:37:06.527556 dv-cinder-815659-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 20:37:06.533304 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: spawned uWSGI worker 1 (pid: 129357, cores: 1) May 12 20:37:06.533304 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: spawned uWSGI worker 2 (pid: 129358, cores: 1) May 12 20:37:06.533304 dv-cinder-815659-7-iscsi devstack@n-api.service[129337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 20:37:07.747489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 20:37:07.761848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 20:37:08.550764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:37:08.550764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: from cryptography.utils import int_from_bytes May 12 20:37:08.551077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:37:08.551077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: from cryptography.utils import int_from_bytes May 12 20:37:08.561197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:37:08.561197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: from cryptography.utils import int_from_bytes May 12 20:37:08.561557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 20:37:08.561557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: from cryptography.utils import int_from_bytes May 12 20:37:11.208169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:37:11.208789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:37:11.209094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:37:11.209381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:37:11.209666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:37:11.210157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.210740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.211326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.211664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.212006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.212328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.212815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.213472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.213907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.214183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.214511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.214985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-7-iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.215582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.216116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.216692 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.217252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.217831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.218409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.218965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.219890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.221412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.221539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.222092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.222663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.223186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.223732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.224356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.224857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.225221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.225577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.226305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-7-iscsi {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.226882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.227459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.227985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.228441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.228776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.229307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.229903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.230487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.230908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.231397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.231750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.233946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.233946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.233946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.233946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.233946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.234506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.234656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.235019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.235191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.235468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.235806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.236153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.236483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.236748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.237017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.237392 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.237715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.238038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.238380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.238685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.239003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.239322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.239639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.239955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.240275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.240611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.240938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.241305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.241938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.241938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.242532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.243028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.243574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.243931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.244269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.244595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.245163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.245834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.246194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.246523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.246846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.247356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.248622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.249161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.249637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.250445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.250995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.251569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.252125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.252682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.253244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.253812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.254355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.254892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.255448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.255990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.256419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.257008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.257648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.258227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.258697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.258957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.259356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.259942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.260510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.261088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.261671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.262022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.262354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.262835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.263472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.264148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.264487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.264950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.265328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.265706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.266050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.266377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.266706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.267044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.267369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.267694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.268017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.268234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 20:37:11.269110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.269110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.269471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 20:37:11.269699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.269699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.270014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 20:37:11.270235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.270391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 20:37:11.270537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.270682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 20:37:11.270835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.270978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.271861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.272026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.272179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.272331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.272475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.272624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.272790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.272941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.273084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.273236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.273427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.273581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.273736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.273884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.274047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.274199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.274342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.274499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.274695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.274844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815659-7-iscsi {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.275126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.275284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.275453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.275733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.275885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.276101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.276294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.276616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.276765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.276953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.277375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.277542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.277686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.277877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.278214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.278520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.278679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.278977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.279712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.279880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.280054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.280054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.280348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.280504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.280694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.280856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.281033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.281370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.281537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.281709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.281950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.282117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.282444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815659-7-iscsi {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.282891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.283061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.283216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.284129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.284129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.284468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.284629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.284629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.284956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.285128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.285128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.285452 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.285598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.285751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.285910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.285910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.286190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.286334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.286479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.286630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.286783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.286990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.287151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.287303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.288543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.288712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.288712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.289175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.289353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.289579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.289937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.290459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.290628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.291005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.291204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.291368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.291534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.291695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.291831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.291931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.292204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.292364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.292552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.292730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.292953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.293255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.293442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.293631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.293805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.294138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.294240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.294467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.295375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.296680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.296680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.296895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.296991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.297076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.297158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.297240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.297240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.297470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.297554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.297634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.297865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.297983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.298215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.298306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.298543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.298624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.298900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.299138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.299248 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.299409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.299543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.299736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.299869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.300265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.300595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.301680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.301820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.301954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.301954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.302209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.302334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.302447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.302557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.302678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.302796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.302907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.303027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.303146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.303257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.303368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.303484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.303605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.303724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.303836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.303954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.304072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.304183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.304307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.304419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.304537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.304660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.304878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.305004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.305204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.305365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.305550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.305799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.305941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.306201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.306426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.306569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.306865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.306997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.307187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.307512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.307644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.307836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.308132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.308336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.308477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.308775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.308969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.309115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.309428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.309671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.309806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.310064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.310888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.311525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.311664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.311664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.311911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.312064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.312240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.312380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.312518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.312733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.312883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.313060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.313266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.313490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.313727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.313871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.314043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.314357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.314507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.314669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.314903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.315050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.315327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.315459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.315683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.316012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.316159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.316344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.316567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.316768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.316984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.317182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.317382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.317643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.317777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.317966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.318205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.318338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.318593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.318777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.318912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.319233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.319366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.319561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.319865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.319999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.320330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.320493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.320665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.321000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.321152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.321490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.321631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.321762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.322171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.322324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.322569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.322802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.322935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.323215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.323405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.323547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.323857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.323990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.324194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.324380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.324715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.324857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.325052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.325241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.325611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.325743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.326053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.326532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.326667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.326797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.326935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.327181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.327325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.327662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.327870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 20:37:11.328004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.328332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.328473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.328663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.328796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.329907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.330042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.330262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.330405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.330634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.330818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.332928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.333990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.334940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.335907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.336103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.336279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.336529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.336774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.336875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.337242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.337357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.337612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.337946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.338047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.338348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.338471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.338795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.338938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.339121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.339459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.339557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.339908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.340005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.340240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.340569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.340670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.340969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.341115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.342625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.342757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.342862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.342862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.343919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.344984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.345147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.345343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.345496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.345677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.345828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.346019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.346120 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.346372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.346513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.346817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.347046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.347189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.347457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.347647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.347937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.348070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.348288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.348532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.348790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.348984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.349341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.349496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.349666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.349922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.350064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.350333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.350529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.350671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.351161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.351294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.351517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.351732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.352067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.352209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.352425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.352660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.352802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.353025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.353260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.353429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.353672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.354013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.354183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.354496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.354645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.354863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.355856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.356820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.357847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.358360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.359382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.359876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.360879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.361962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.362935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.363924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.364825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.365025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.365327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.365475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.365733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.365864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.366114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.366309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.366441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.366738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.366937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.367196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.367328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.367583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.367799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.367932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.368259 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.368445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.368614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.368936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.369090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.369339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.369477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.369805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.369939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.370130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.370505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.370645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.370861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.371099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.371245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.371521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.371658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.371849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.372149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.372289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.372488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.373716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.373930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.373930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.374948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.375404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.375727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.375870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.376063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.376274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.376413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.376703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.376833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.377050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.377356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.377490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.377708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.377892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.378041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.378365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.378495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.378698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.378954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.379087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.379400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.379553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.379816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.380015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.380146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.380445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.380590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.380917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.381056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.381265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.381607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.381830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.381994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.382327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.382465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.382652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.382990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.383135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.383300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.383522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.383691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.383925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.384185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.384327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.384560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.384701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.385019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.385162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.385396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.385724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.385865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.386051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.386291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.386570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.386789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.387122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.387280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.387455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.387687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.387830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.388014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.388165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.388379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.388712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.388882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.389954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.390151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.390455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.390604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.390795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.390945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.391894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.392883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.393915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.394914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.395902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396082 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.396867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.397869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.398874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.399813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.400397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.400554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.400696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.400826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.400965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.401096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.401232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.401677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.401826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.402078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.402262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.402398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.402722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.402873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.403059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.403388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.403537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.403798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.404014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.404758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.404898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.405876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.406180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.406393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.406535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.406849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.406991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.407208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.407502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.407646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.407957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.408089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.408326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.408608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.408828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.409078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.409451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.409609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.409827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.410035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.410207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.410407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.410802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.410950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.411143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.411406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.411547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.411775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.411941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.412094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.412233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.412417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.412551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.412799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.418995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.419155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.419295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.419427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420058 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.420868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421311 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.421965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.422883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.423910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424626 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.424905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.425899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.426970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.427909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.428875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.429909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.430992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.431925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.432874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.433710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.434876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.435020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.435180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436626 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.436899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.437888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.438956 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.439909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.440903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.441988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.442927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443665 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.443941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.444892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.445880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.446930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.447871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.448937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.449880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.450860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.451256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.451486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.451625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.451756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.451900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.452976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.453900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454160 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.454928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.455887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.456942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.457907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.458997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.459891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460836 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.460966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.461863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.462925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.463848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.464816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.465989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.466124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.467729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.467871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.467986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.468938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.469785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.470884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.471972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.472893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.473946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474786 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.474925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.475884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.476962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.477847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.478982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.479924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480686 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.480858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.481993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.482832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.482977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.483263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.483398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.483580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.483715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.483894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.484904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485392 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.485914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.486879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.487979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.488926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.489888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.490980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.491124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.491406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.491554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.491685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.491816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.492968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.493920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.494910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495392 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.495917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.496882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.497927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.498061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.498273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.498562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.498710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.498897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.499873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.500014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.500450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.500591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.500772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.500907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.501903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.502845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.503954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.504676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.504828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.504976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.505953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.506910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507456 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.507863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.508947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.509131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.509265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.509498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.509642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.509776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.510849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.511989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.512940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.513080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.513342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.513531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.513665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.513984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.514946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.515897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.516865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.517976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.518924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.519865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.520976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.521119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.521379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.521528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.521714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.521854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.522025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.522165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.522298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:37:11.522434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.522652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.522971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.523302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.523623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.523942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.524297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.524623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.525169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.525574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.525867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.526208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.526550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.526867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.527185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.527504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.527837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.528157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.528475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.528794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.529712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.530031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.530351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.530669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.530987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.531306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.531624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.531941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.532258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.532579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.532927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.533256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.533604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.533929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.534255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.534575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.534894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.535212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.535589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.535852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.536191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.536514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.536827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.537261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.537602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.537928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.538256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.538573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.538905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.539236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.539554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.539888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.540203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.540542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.541022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.541445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.541793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.541933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.542199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.546112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.546112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.546112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.546430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.546743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.547055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.547365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.547678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.547785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.547989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.548302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.548618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.548928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.549238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.549679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.550000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.550314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.550662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.550990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.551325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.551641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.551975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.552291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.552607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.552940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.553285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.553615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.553934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.554325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.554590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.554911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.555231 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.555590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.556080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.556317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.556549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.556883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.557199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.557561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.557888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.558216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.558541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.558861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.559197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.559517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.559834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.560200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.560524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.560935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.561264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.561612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.561948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.562283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.562619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.562958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.563315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.563637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.563990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.564329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.564652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.564973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.565315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 20:37:11.565562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 20:37:11.588688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_db.sqlalchemy.engines [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.612712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.context [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9fde6af-dc03-4b65-925d-792b71d3bae1(cell1) {{(pid=129358) load_cells /opt/stack/nova/nova/context.py:464}} May 12 20:37:11.619524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:37:11.619524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:37:11.619908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:37:11.621556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:37:11.635130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.660477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.context [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9fde6af-dc03-4b65-925d-792b71d3bae1(cell1) {{(pid=129357) load_cells /opt/stack/nova/nova/context.py:464}} May 12 20:37:11.664918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:37:11.666557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:37:11.667377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:37:11.669338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:37:11.682332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_db.sqlalchemy.engines [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.683980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_db.sqlalchemy.engines [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.782277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.802884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_db.sqlalchemy.engines [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:11.849140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_db.sqlalchemy.engines [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 20:37:12.135385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: WARNING keystonemiddleware.auth_token [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:37:12.143098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: WARNING keystonemiddleware.auth_token [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:37:12.176576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: WARNING keystonemiddleware.auth_token [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:37:12.184553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: WARNING keystonemiddleware.auth_token [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:37:12.494049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: WARNING keystonemiddleware.auth_token [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:37:12.500585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: WARNING keystonemiddleware.auth_token [None req-cc801d96-6d6f-4c4a-b543-90343563e6ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:37:12.505790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651adf769c0 pid: 129358 (default app) May 12 20:37:12.534320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: WARNING keystonemiddleware.auth_token [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 20:37:12.540461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: WARNING keystonemiddleware.auth_token [None req-d609fb29-a516-4f20-8975-21ac2aa89163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 20:37:12.546390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651adf769c0 pid: 129357 (default app) May 12 20:37:57.150436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-29c4dc15-ecdc-4266-9667-089e89cd4540 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Action: 'create', calling method: .version_select at 0x7f4e68f29280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2040574887", "metadata": {"Type": "work"}}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:37:58.335980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-517829221", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "networks": [{"uuid": "e424c801-60ae-4333-9081-127dc25edff2"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:37:58.455883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-29c4dc15-ecdc-4266-9667-089e89cd4540 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.551907 May 12 20:37:58.455883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Thu May 12 20:37:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2555 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 20:37:58.495529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d17a194e-1278-4c0f-a6eb-4fe8afdd8269 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d82280>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:37:58.690828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d17a194e-1278-4c0f-a6eb-4fe8afdd8269 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 200 len: 353 microversion: 2.1 time: 0.227026 May 12 20:37:58.695892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 2/2] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:37:58 2022] GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:37:59.319483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] validate_networks() for [('e424c801-60ae-4333-9081-127dc25edff2', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:37:59.704400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7c766250-14fd-4567-9527-f8f27f51c79d tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d824c0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:00.011976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7c766250-14fd-4567-9527-f8f27f51c79d tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 200 len: 354 microversion: 2.1 time: 0.312456 May 12 20:38:00.012548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 3/3] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:37:59 2022] GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:38:00.019001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-311a0c5d-2acd-46be-9992-a3e724dbc628 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68d829d0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:00.296375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-311a0c5d-2acd-46be-9992-a3e724dbc628 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6cf63986-4fb7-4045-a924-3295a1fc0383" status: 200 len: 351 microversion: 2.1 time: 0.209036 May 12 20:38:00.296375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 4/4] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:00 2022] GET /compute/v2.1/os-volumes/6cf63986-4fb7-4045-a924-3295a1fc0383 => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:00.296375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1ccb776b-4406-4300-9a45-239f3f6695c3 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d84160>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:00.620653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1ccb776b-4406-4300-9a45-239f3f6695c3 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 200 len: 354 microversion: 2.1 time: 0.391788 May 12 20:38:00.632476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 5/5] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:00 2022] GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 354 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:00.640128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b5e473de-2091-4773-8118-971fb29b4402 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d84820>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:01.009401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:38:01.009861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:38:01.010273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:38:01.010682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:38:01.011091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:38:01.046884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:01.047256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:01.048241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:01.048822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:01.120069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Getting quotas for project 1ca3db22ad6a4c14a5e86696a8cb43f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:01.121594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b5e473de-2091-4773-8118-971fb29b4402 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 202 len: 0 microversion: 2.1 time: 0.486553 May 12 20:38:01.123115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 6/6] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:38:00 2022] DELETE /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:38:01.131346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4194fbdf-2420-4708-8227-9926f61cdfa9 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d82ca0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:01.137232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Getting quotas for user 0034ea4df67849d193d6fabca6395773 and project 1ca3db22ad6a4c14a5e86696a8cb43f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:01.190192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:38:01.215921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:38:01.349815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4194fbdf-2420-4708-8227-9926f61cdfa9 tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 200 len: 353 microversion: 2.1 time: 0.222530 May 12 20:38:01.350374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 7/7] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:01 2022] GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:38:01.496264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8cab720d-a35c-491f-a483-43e63e275905 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.076760 May 12 20:38:01.506780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1/8] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 20:38:01.516242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-815ae212-a92f-44dd-b868-ba18674ad0c4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:01.517030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-815ae212-a92f-44dd-b868-ba18674ad0c4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:01.835452 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-815ae212-a92f-44dd-b868-ba18674ad0c4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:01.884743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-815ae212-a92f-44dd-b868-ba18674ad0c4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1214 microversion: 2.1 time: 0.372826 May 12 20:38:01.887319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 8/9] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:01 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:02.373064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-55c973b2-f1bb-4021-aba9-d4b65c45c9c4 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68d46820>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:02.373886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be5e8e26-c605-4817-b589-6490f143dfed tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Calling method '.version_select at 0x7f4e68d2e280>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:02.484111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-55c973b2-f1bb-4021-aba9-d4b65c45c9c4 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/44277692-f530-4c6f-8f06-2a8bb664635b" status: 200 len: 351 microversion: 2.1 time: 0.116047 May 12 20:38:02.485140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 9/10] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:02 2022] GET /compute/v2.1/os-volumes/44277692-f530-4c6f-8f06-2a8bb664635b => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:02.555097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-be5e8e26-c605-4817-b589-6490f143dfed tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] HTTP exception thrown: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be5e8e26-c605-4817-b589-6490f143dfed tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Request method failure captured: May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c HTTP/1.1 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAjbVygqhJarCEHOo94Xh1YILzt3242vOd2PsOFZ-J_v9b3kpN38iEqg7_-4LomKGCD8pFgdEBpVpOeQe4JZDEePOP91WTZSdliAR8RRSdO-H7qpXjT4AQCEudK83RuqsFDMf81ESGbbZ9Exe6ck3eRwlFdoZpbWSUMm4kR1C0GQKM May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: afac0ca364954724a9a7c36f702c2d00 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesGetTestJSON-2063536508 May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:38:02.560482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/afac0ca364954724a9a7c36f702c2d00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_afac0ca364954724a9a7c36f702c2d00", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/afac0ca364954724a9a7c36f702c2d00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/afac0ca364954724a9a7c36f702c2d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesGetTestJSON-2063536508 May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: afac0ca364954724a9a7c36f702c2d00 May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesGetTestJSON-2063536508 May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesGetTestJSON-2063536508-project May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 4982c1d62c194b7a9c4d8b4f064a21e1 May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesGetTestJSON-2063536508-project May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '410583e4-647c-43f6-be92-3c0a9293bf5c'} May 12 20:38:02.561995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. (HTTP 404) (Request-ID: req-8ae98376-07d3-45e5-b735-6696c9bf81ce) May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:02.562606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:38:02.563470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 20:38:02.564307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be5e8e26-c605-4817-b589-6490f143dfed tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] Returning 404 to user: Volume 410583e4-647c-43f6-be92-3c0a9293bf5c could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:02.565206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-be5e8e26-c605-4817-b589-6490f143dfed tempest-VolumesGetTestJSON-2063536508 tempest-VolumesGetTestJSON-2063536508-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c" status: 404 len: 109 microversion: 2.1 time: 0.194077 May 12 20:38:02.572482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 2/11] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:02 2022] GET /compute/v2.1/os-volumes/410583e4-647c-43f6-be92-3c0a9293bf5c => generated 109 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:38:02.905072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28ff7235-6e19-4dcf-aa29-b5a216827a99 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:02.905989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28ff7235-6e19-4dcf-aa29-b5a216827a99 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:03.270806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28ff7235-6e19-4dcf-aa29-b5a216827a99 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:03.277823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28ff7235-6e19-4dcf-aa29-b5a216827a99 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1214 microversion: 2.1 time: 0.377215 May 12 20:38:03.278629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 10/12] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:02 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1214 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:04.314398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-21e9bce3-1fdb-48bc-81a1-01fb3d58457e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:04.316208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21e9bce3-1fdb-48bc-81a1-01fb3d58457e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:04.664347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-21e9bce3-1fdb-48bc-81a1-01fb3d58457e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:04.693934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-21e9bce3-1fdb-48bc-81a1-01fb3d58457e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1214 microversion: 2.1 time: 0.393629 May 12 20:38:04.695977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 3/13] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:04 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1214 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:05.713588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:05.714332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:05.736420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:05.736887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:05.739026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:05.739517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:06.194659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:06.238433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-20984ff9-f5a0-47d9-9abc-5c002b209f0f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1218 microversion: 2.1 time: 0.525617 May 12 20:38:06.249371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 11/14] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:05 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1218 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:06.833946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f5cd3c5-5150-43ac-a235-7e309f384f6d tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e6849a550>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:06.990129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f5cd3c5-5150-43ac-a235-7e309f384f6d tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/b3bd20a2-5e70-4de7-a395-05fe61880d74" status: 200 len: 351 microversion: 2.1 time: 0.160244 May 12 20:38:06.990961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 4/15] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:06 2022] GET /compute/v2.1/os-volumes/b3bd20a2-5e70-4de7-a395-05fe61880d74 => generated 351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:07.002250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ea227b9e-e226-423e-887a-90ab9e0ac8bc tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e6840d5e0>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:07.149388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-df069c31-1e66-4534-8d00-86ca9e61aa5c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: .version_select at 0x7f4e68ccb5e0>, body: {"keypair": {"name": "tempest-keypair-1611159299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPle2YlLOBttmru9BYDwVcU8rh0/HcVvJ5WNitThse/73kNHqEHclOR7oAnnu4njBwEFuPq+hHu+QFXl2hGyaqzJONOtJWv5u4MHiF+xO0jyDMA2JjCmM0f5f8m0d1NdEw=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:07.200964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ea227b9e-e226-423e-887a-90ab9e0ac8bc tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.202298 May 12 20:38:07.201860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 5/16] 10.222.0.59 () {58 vars in 1133 bytes} [Thu May 12 20:38:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:07.219773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0336e9d1-4d60-4c91-bcee-2b08fd9a5866 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68408310>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:07.254925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-df069c31-1e66-4534-8d00-86ca9e61aa5c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for project e3bcc803e53f46efb996577417eca77a. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:07.275825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-df069c31-1e66-4534-8d00-86ca9e61aa5c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for user 64ce721d7163430dbf31ffbbf28c2094 and project e3bcc803e53f46efb996577417eca77a. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:07.418953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0336e9d1-4d60-4c91-bcee-2b08fd9a5866 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.205287 May 12 20:38:07.419990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 6/17] 10.222.0.59 () {58 vars in 1148 bytes} [Thu May 12 20:38:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:07.424909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:07.425713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:07.439999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:07.443892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:07.444903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:07.445630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:07.473916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-df069c31-1e66-4534-8d00-86ca9e61aa5c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.583643 May 12 20:38:07.474754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 12/18] 10.222.0.59 () {62 vars in 1199 bytes} [Thu May 12 20:38:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 585 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 20:38:07.486075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-45c26c35-e37a-4360-b181-e09d18b0bc56 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68c65280>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:07.654017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-45c26c35-e37a-4360-b181-e09d18b0bc56 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.171617 May 12 20:38:07.655186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 13/19] 10.222.0.59 () {58 vars in 1133 bytes} [Thu May 12 20:38:07 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:07.668223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6f35ff90-c179-413e-bbf8-a9183eb68b08 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68c65ee0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:07.921868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6f35ff90-c179-413e-bbf8-a9183eb68b08 tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259722 May 12 20:38:07.923035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 14/20] 10.222.0.59 () {58 vars in 1166 bytes} [Thu May 12 20:38:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:07.934676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9a23320b-0b0a-4e09-a735-74e4812c85cd tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68ccbd30>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:08.121819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9a23320b-0b0a-4e09-a735-74e4812c85cd tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.189619 May 12 20:38:08.121819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 15/21] 10.222.0.59 () {58 vars in 1169 bytes} [Thu May 12 20:38:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:38:08.134783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dc915d30-45ed-48af-8135-a4e5fb99676c tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68417940>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:08.135107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:08.179896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ff23d69c-2565-43ad-9711-c6536693d4b2 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1274 microversion: 2.1 time: 0.756681 May 12 20:38:08.181423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 7/22] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:07 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1274 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:08.446902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dc915d30-45ed-48af-8135-a4e5fb99676c tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.317343 May 12 20:38:08.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 16/23] 10.222.0.59 () {58 vars in 1154 bytes} [Thu May 12 20:38:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:08.467989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1b4b5a3a-4cbb-49ef-a843-ae3dccf81f5b tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e6839fc10>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:08.724860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1b4b5a3a-4cbb-49ef-a843-ae3dccf81f5b tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.269056 May 12 20:38:08.725929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 8/24] 10.222.0.59 () {58 vars in 1187 bytes} [Thu May 12 20:38:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:08.738799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f4e02ca0-86e9-4355-a732-0266735233ec tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] Calling method '.version_select at 0x7f4e68417d30>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:08.983935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f4e02ca0-86e9-4355-a732-0266735233ec tempest-VolumesTestJSON-844912866 tempest-VolumesTestJSON-844912866-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.249469 May 12 20:38:08.991050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 17/25] 10.222.0.59 () {58 vars in 1154 bytes} [Thu May 12 20:38:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:09.203390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:09.204074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:09.223750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:09.226055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:09.226055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:09.226055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:09.853475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:09.873087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1a9e1bc0-11da-4ae8-86b7-5960ab274913 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1272 microversion: 2.1 time: 0.675397 May 12 20:38:09.884648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 9/26] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:09 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1272 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:10.913856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:10.914413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:10.936242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:10.938380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:10.941919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:10.962155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:11.265717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:11.279081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ae0cf6b2-00a8-4a4b-884d-246d39d05311 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1272 microversion: 2.1 time: 0.379833 May 12 20:38:11.284539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 18/27] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:10 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1272 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:12.095559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f8708e85-f82c-4825-9f9d-3cfc76f26f75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: .version_select at 0x7f4e6907c8b0>, body: {"keypair": {"name": "tempest-keypair-980706035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/2+hG+aA0j+5OwTkh3VXYAN6mksUMjkqxRqh+LLAf2Z5yl2hZBs3NCcpflnYk5yRCnwAFA1ocCDbxvA58XQhPQ6guxr7/8OvU5wR6qbXxA5cZ34M1UjrCxLCZ+HRtXSw=="}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:12.158678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-f8708e85-f82c-4825-9f9d-3cfc76f26f75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:12.172985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-f8708e85-f82c-4825-9f9d-3cfc76f26f75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:12.381412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1959568748", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:12.429981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f8708e85-f82c-4825-9f9d-3cfc76f26f75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.653872 May 12 20:38:12.430599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 10/28] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:38:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:12.442146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:12.453810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:12.491204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:12.491522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:12.502419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:12.504313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:12.668764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] validate_networks() for [('608928ff-7e35-4432-8949-a8f5a8ad9a82', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:38:12.950982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:12.962186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9f69e32a-a277-41dc-93b2-fc2040b21586 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.530138 May 12 20:38:12.963056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 11/29] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:12 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:14.005108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:14.008795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:14.077494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:14.080824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:14.082073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:14.089739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:15.300441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:38:15.301024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:38:15.302207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:38:15.302881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:38:15.303508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:38:15.333150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:15.336545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:15.346781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:15.348865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:15.349242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-acb451da-3785-46eb-a98a-7fbdc14e6577 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 1.370313 May 12 20:38:15.350782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:15.360954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 12/30] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:13 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:15.450907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:15.473256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for user 2a2b95ccb7804311a011f37ccb371771 and project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:15.522270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:38:15.541558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:38:15.924775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-008496d2-1c17-4530-a542-410d37c5645f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.740428 May 12 20:38:15.928356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 19/31] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:38:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 20:38:15.944073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f9cea38f-4110-4414-a96d-bff7d275c8c5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:15.947301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f9cea38f-4110-4414-a96d-bff7d275c8c5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:16.367133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:16.367760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:16.395832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:16.401292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:16.406068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:16.408463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:16.666148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f9cea38f-4110-4414-a96d-bff7d275c8c5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:16.675445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f9cea38f-4110-4414-a96d-bff7d275c8c5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1222 microversion: 2.1 time: 0.739507 May 12 20:38:16.678158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 13/32] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:15 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1222 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:16.798058 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1163229829", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:16.866612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] validate_networks() for [('608928ff-7e35-4432-8949-a8f5a8ad9a82', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:38:17.724484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:17.732930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a84d5f25-7215-4942-aae0-c01299f11af1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 1.370048 May 12 20:38:17.745662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 20/33] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:16 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:18.762688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:18.764144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:18.780045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:18.780956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:18.784370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:18.789366 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:19.511426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:19.524175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-067ebe3c-199d-4d8f-b379-f3e2edd8d788 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.770507 May 12 20:38:19.524783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 21/34] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:18 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:19.536284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-304303888", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa5bcf78-e33b-4c87-a2bb-4b70380d365f"}], "security_groups": [{"name": "tempest-securitygroup--1269681072"}], "key_name": "tempest-keypair-1611159299", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:19.802967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] validate_networks() for [('aa5bcf78-e33b-4c87-a2bb-4b70380d365f', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:38:20.077568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:38:20.078508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:38:20.079132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:38:20.079793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:38:20.080350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:38:20.109677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:20.110292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:20.113633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:20.117759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:20.177233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:20.188302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for user 2a2b95ccb7804311a011f37ccb371771 and project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:20.219888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:38:20.225016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:38:20.510067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-644427d4-9d63-4a12-ad98-0612d9ae6626 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.710739 May 12 20:38:20.515298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 14/35] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:38:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 20:38:21.240599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:38:21.241135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:38:21.241681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:38:21.242141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:38:21.242568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:38:21.258356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-1f1f1c4c-b8f9-489b-8d52-a9712d50dfbe req-34cf41c9-f5e5-4c10-a80b-62128d0a658f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6", "tag": "41b33746-5b6f-4d2a-882a-9333fb8eee47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:21.263711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.264159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.271363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.273001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.328099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for project e3bcc803e53f46efb996577417eca77a. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:21.344855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-1f1f1c4c-b8f9-489b-8d52-a9712d50dfbe req-34cf41c9-f5e5-4c10-a80b-62128d0a658f service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.347025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for user 64ce721d7163430dbf31ffbbf28c2094 and project e3bcc803e53f46efb996577417eca77a. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:21.348554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-1f1f1c4c-b8f9-489b-8d52-a9712d50dfbe req-34cf41c9-f5e5-4c10-a80b-62128d0a658f service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.382694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:38:21.394861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:38:21.478455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-1f1f1c4c-b8f9-489b-8d52-a9712d50dfbe req-34cf41c9-f5e5-4c10-a80b-62128d0a658f service nova] Creating event network-changed:41b33746-5b6f-4d2a-882a-9333fb8eee47 for instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 on hv-cinder-81565 May 12 20:38:21.488432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-1f1f1c4c-b8f9-489b-8d52-a9712d50dfbe req-34cf41c9-f5e5-4c10-a80b-62128d0a658f service nova] Acquired lock "compute-rpcapi-router" {{(pid=129357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 20:38:21.499077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.500077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.502379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.502379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.536291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.compute.rpcapi [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 20:38:21.538716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] Releasing lock "compute-rpcapi-router" {{(pid=129357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 20:38:21.589477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-01356caf-0377-4e75-93a5-6b0fcbc3588c None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.072461 May 12 20:38:21.595818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 15/36] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:21.601716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-38d4fa4b-7ef1-420c-b83b-fa8299f0dc7b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:21.602547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-38d4fa4b-7ef1-420c-b83b-fa8299f0dc7b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:21.732653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af9dcc1f-bc1a-459e-88a4-8d09e13ea988 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.206747 May 12 20:38:21.748605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 22/37] 10.222.0.59 () {62 vars in 1187 bytes} [Thu May 12 20:38:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 20:38:21.770659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:21.771065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:21.788531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.789290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.790301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:21.790910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:21.904476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-38d4fa4b-7ef1-420c-b83b-fa8299f0dc7b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:21.915218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-38d4fa4b-7ef1-420c-b83b-fa8299f0dc7b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1222 microversion: 2.1 time: 0.317948 May 12 20:38:21.926605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 16/38] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:21 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1222 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:21.976347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-213293938", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8378bf4-b568-4478-81bf-9948fffba758"}], "security_groups": [{"name": "tempest-securitygroup--772842372"}], "key_name": "tempest-keypair-980706035", "user_data": "}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:22.228305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:22.236080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ecc34b65-46e5-43d6-b880-a864d1a1b993 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.486364 May 12 20:38:22.236673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 23/39] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:21 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:22.266418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:22.269384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:22.411588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:22.421390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:22.428819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:22.428819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-84889ffb-1392-4f75-8478-0318f7dc0ceb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1281 microversion: 2.20 time: 0.168002 May 12 20:38:22.428819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 24/40] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:22 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:22.516103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] validate_networks() for [('e8378bf4-b568-4478-81bf-9948fffba758', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:38:22.943115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:22.943746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:22.955457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:22.956058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:22.956831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:22.966367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:23.388380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:23.422583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91f6587c-b5eb-4cc2-b709-ee3fa0cd94b7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1274 microversion: 2.1 time: 0.483818 May 12 20:38:23.430173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 25/41] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:22 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1274 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:23.987494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:38:23.988464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:38:23.989391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:38:23.990539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:38:23.991183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:38:24.001264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6cd1b93c-38d5-4943-a997-467e9c98fdc2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Action: 'create', calling method: .version_select at 0x7f4e68367ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1241049758", "metadata": {"Type": "work"}}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6cd1b93c-38d5-4943-a997-467e9c98fdc2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 122 May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:38:24.024783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1241049758", "metadata": {"Type": "work"}}} May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: May 12 20:38:24.026137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1241049758', 'metadata': {'Type': 'work'}}}} May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise error May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi '#$%' May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:24.026895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 20:38:24.028534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 20:38:24.037410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 20:38:24.037410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:24.037410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6cd1b93c-38d5-4943-a997-467e9c98fdc2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:24.037410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6cd1b93c-38d5-4943-a997-467e9c98fdc2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.595191 May 12 20:38:24.037410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 26/42] 10.222.0.59 () {60 vars in 1155 bytes} [Thu May 12 20:38:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 596 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:38:24.037759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.037759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.037759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.037759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.039020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:24.039858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:24.067376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.067995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.068941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.069871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.104397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:38:24.121947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:38:24.151739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:38:24.167444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:38:24.431298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c7fdc371-0276-4451-932e-d7b62aa7b6e9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.499759 May 12 20:38:24.441634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 17/43] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:38:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:38:24.458341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:24.459441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:24.500472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.502735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.503840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.505053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:24.800486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:24.804125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:24.806787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0b3515ea-9450-47ac-8cbe-041ff9c77bdd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1277 microversion: 2.20 time: 0.363105 May 12 20:38:24.817736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 18/44] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:24 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:24.817736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a9cdb97a-28a4-43b6-9934-c5269ef96b07 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Action: 'create', calling method: .version_select at 0x7f4e683709d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-660739810", "metadata": {"Type": "work"}}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a9cdb97a-28a4-43b6-9934-c5269ef96b07 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 119 May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:38:24.819527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-660739810", "metadata": {"Type": "work"}}} May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:38:24.820865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-660739810', 'metadata': {'Type': 'work'}}}} May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise error May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi '0' May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:24.821713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 20:38:24.823078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 20:38:24.825760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 20:38:24.825760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:24.825760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a9cdb97a-28a4-43b6-9934-c5269ef96b07 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:24.825760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a9cdb97a-28a4-43b6-9934-c5269ef96b07 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012253 May 12 20:38:24.829098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 19/45] 10.222.0.59 () {60 vars in 1155 bytes} [Thu May 12 20:38:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:38:24.847188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:24.849401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:24.863724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.864180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.868729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:24.868729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:24.994739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:25.005433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d2a33e5b-d6b2-4a90-9435-714ae3fc2120 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1280 microversion: 2.1 time: 0.177041 May 12 20:38:25.012552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 20/46] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:24 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:25.032175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9790fce6-8c86-4b3f-b5a0-3a5639d6e00b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:25.035468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9790fce6-8c86-4b3f-b5a0-3a5639d6e00b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:25.078905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:25.138289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1e60044-c5a8-40bf-8c56-1fd91f3ccdf1 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 1.101790 May 12 20:38:25.138289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 27/47] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:24 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:25.149613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d25ae52-6606-4bcd-9ee7-a03a836e00b2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Action: 'create', calling method: .version_select at 0x7f4e683674c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-904370636", "metadata": {"Type": "work"}}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d25ae52-6606-4bcd-9ee7-a03a836e00b2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 118 May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:38:25.152436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-904370636", "metadata": {"Type": "work"}}} May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: May 12 20:38:25.153950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-904370636', 'metadata': {'Type': 'work'}}}} May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise error May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi '' May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:25.154740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 20:38:25.156286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 20:38:25.157431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 20:38:25.157431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.157431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d25ae52-6606-4bcd-9ee7-a03a836e00b2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:25.161350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0d25ae52-6606-4bcd-9ee7-a03a836e00b2 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022193 May 12 20:38:25.166720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 28/48] 10.222.0.59 () {60 vars in 1155 bytes} [Thu May 12 20:38:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:38:25.178081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f92fffd-d5f3-48ef-82c5-819bd54202ef tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Calling method '.version_select at 0x7f4e683b3700>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:25.206382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9790fce6-8c86-4b3f-b5a0-3a5639d6e00b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:25.213670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9790fce6-8c86-4b3f-b5a0-3a5639d6e00b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1240 microversion: 2.1 time: 0.187660 May 12 20:38:25.216676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 21/49] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:25 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1240 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:25.297431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-1f92fffd-d5f3-48ef-82c5-819bd54202ef tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] HTTP exception thrown: Volume tempest-invalid-2019936347 could not be found. May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f92fffd-d5f3-48ef-82c5-819bd54202ef tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2019936347 HTTP/1.1 May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:38:25.301446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Volume tempest-invalid-2019936347 could not be found. May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': 'tempest-invalid-2019936347'} May 12 20:38:25.302737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2019936347 could not be found. (HTTP 404) (Request-ID: req-2a5cc357-2c53-4ca2-8dea-17e75c5f26aa) May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.303630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:38:25.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2019936347 could not be found. May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:38:25.306264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2019936347 could not be found. May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2019936347 could not be found. May 12 20:38:25.307442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.309569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f92fffd-d5f3-48ef-82c5-819bd54202ef tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 404 to user: Volume tempest-invalid-2019936347 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:25.310902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1f92fffd-d5f3-48ef-82c5-819bd54202ef tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2019936347" status: 404 len: 99 microversion: 2.1 time: 0.136871 May 12 20:38:25.311908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 29/50] 10.222.0.59 () {58 vars in 1217 bytes} [Thu May 12 20:38:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2019936347 => generated 99 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 20:38:25.321976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3b7fdf95-9406-4368-857c-44411561e752 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004882 May 12 20:38:25.322777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 22/51] 10.222.0.59 () {58 vars in 1139 bytes} [Thu May 12 20:38:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 12 20:38:25.351298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c9216812-c028-4c94-877e-aa84c58f9df0 tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017005 May 12 20:38:25.351817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 30/52] 10.222.0.59 () {58 vars in 1136 bytes} [Thu May 12 20:38:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 20:38:25.362859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74f07e2f-ac3c-4d19-9306-c9ac7418165e tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Calling method '.version_select at 0x7f4e68370700>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-74f07e2f-ac3c-4d19-9306-c9ac7418165e tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] HTTP exception thrown: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74f07e2f-ac3c-4d19-9306-c9ac7418165e tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/os-volumes/f38b806d-4159-4787-81b4-a4952c0175bd HTTP/1.1 May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:38:25.439470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'f38b806d-4159-4787-81b4-a4952c0175bd'} May 12 20:38:25.442086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. (HTTP 404) (Request-ID: req-e94c9548-059d-46c3-8c32-b58b6ca19aee) May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.455034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:38:25.456687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 20:38:25.458590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74f07e2f-ac3c-4d19-9306-c9ac7418165e tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 404 to user: Volume f38b806d-4159-4787-81b4-a4952c0175bd could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-74f07e2f-ac3c-4d19-9306-c9ac7418165e tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/f38b806d-4159-4787-81b4-a4952c0175bd" status: 404 len: 109 microversion: 2.1 time: 0.045036 May 12 20:38:25.459838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 23/53] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:38:25 2022] DELETE /compute/v2.1/os-volumes/f38b806d-4159-4787-81b4-a4952c0175bd => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:38:25.464057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f325ade6-6606-4af3-be36-abab6f08b57f tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Calling method '.version_select at 0x7f4e683b3e50>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:25.536016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-f325ade6-6606-4af3-be36-abab6f08b57f tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] HTTP exception thrown: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f325ade6-6606-4af3-be36-abab6f08b57f tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Request method failure captured: May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/os-volumes/5af59d9e-c665-499e-98fe-346d824f69ca HTTP/1.1 May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXA_l5NR_Tg7OkRKkjxvgybWj9AEa-x_rHb9TLsmbCt15CA-wzVWcALiBCC-EKxdKVI0sOLE6Xp_Qovpo9tCAahwntSKe3fH-7A-nWEWSewIH0GEGYpxe0A7CnyKltMvSS0jHnfV2ujxyfVRnlElfcXty9Tqu-suS0TZ0U_MD8E5vgY May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:38:25.538021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8cf46310631c484790071f4ff000748e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8cf46310631c484790071f4ff000748e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8cf46310631c484790071f4ff000748e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 8cf46310631c484790071f4ff000748e May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesNegativeTest-558647209 May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 4cc761d6dde14282b0c6ddb70ef90ee4 May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesNegativeTest-558647209-project May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '5af59d9e-c665-499e-98fe-346d824f69ca'} May 12 20:38:25.539673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. (HTTP 404) (Request-ID: req-49d4dd27-100d-4382-b449-5222d1e759ce) May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.551087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:38:25.553097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 20:38:25.554205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f325ade6-6606-4af3-be36-abab6f08b57f tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] Returning 404 to user: Volume 5af59d9e-c665-499e-98fe-346d824f69ca could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f325ade6-6606-4af3-be36-abab6f08b57f tempest-VolumesNegativeTest-558647209 tempest-VolumesNegativeTest-558647209-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5af59d9e-c665-499e-98fe-346d824f69ca" status: 404 len: 109 microversion: 2.1 time: 0.080580 May 12 20:38:25.555453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 31/54] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:38:25 2022] GET /compute/v2.1/os-volumes/5af59d9e-c665-499e-98fe-346d824f69ca => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:38:25.842259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:25.849795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:25.866396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:25.866914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:25.867722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:25.868167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.030709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:26.035272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:26.047731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.050750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.052557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.054230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.059372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:26.071014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:26.073116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:26.075608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0e655391-a75e-4aa8-98f4-33554825a839 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1333 microversion: 2.20 time: 0.252252 May 12 20:38:26.090387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 24/55] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:25 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1333 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:26.153139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:26.153957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:26.189555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.190163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.191002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.199603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.875410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:26.888579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c5a49097-d877-4c7a-9da5-aed3b1289aad tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.863667 May 12 20:38:26.897864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 32/56] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:26 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:26.900399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:26.901023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:26.934651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.935240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:26.937033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:26.939864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:27.129779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:27.139600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-126f17bf-bfce-47b9-940d-29acbf29d081 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1244 microversion: 2.1 time: 0.244086 May 12 20:38:27.141617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 33/57] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:26 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1244 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:27.150491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:27.152856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:27.159251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:27.160000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:27.161119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:27.162110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:27.247357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:27.252109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:27.260380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-898744d4-c09c-49b7-ab83-c989708e6c26 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 1.112145 May 12 20:38:27.260902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:27.267223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:27.271400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 25/58] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:26 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:27.272113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cecbdff6-e2cb-4d9f-acd3-5390340692a8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1339 microversion: 2.20 time: 0.128419 May 12 20:38:27.272887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 34/59] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:27 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:27.910509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:27.916726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:27.935877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:27.936270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:27.937067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:27.937527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.159116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:28.159820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:28.173521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.181423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.186172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.208902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.318384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.328383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2c6aa9d0-cab0-4130-9cdb-1b0aa498111d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1292 microversion: 2.1 time: 0.174610 May 12 20:38:28.338199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 35/60] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:28 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1292 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:28.338199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:28.338199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:28.345197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.345969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.346966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.347639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.480601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.501879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d62689db-24a6-4153-a50c-dbf092e6636a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.593499 May 12 20:38:28.505118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 26/61] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:27 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:28.515934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:28.516563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:28.529622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.530076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.530996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:28.531608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:28.748697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.749937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.758062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c74e86d9-6690-4f68-8f6e-ff6d4f6e602f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.427158 May 12 20:38:28.759268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.760226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:28.762666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1e0aa4d6-1507-419c-a296-e9057ad994fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.255176 May 12 20:38:28.763945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 27/62] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:28 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:28.768021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 36/63] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:28 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:29.290761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-96d7c79e-35fa-48aa-8090-de114e6f1cea req-04fc6864-95c2-4684-931c-41fd74e4efde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a63ea-b229-4fd8-afd1-e8d6c28c1248", "tag": "e613f8bc-8de6-4b77-bfee-c36f3c4c5106"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:29.311238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-96d7c79e-35fa-48aa-8090-de114e6f1cea req-04fc6864-95c2-4684-931c-41fd74e4efde service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.312638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-96d7c79e-35fa-48aa-8090-de114e6f1cea req-04fc6864-95c2-4684-931c-41fd74e4efde service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.349336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:29.349818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:29.370706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-96d7c79e-35fa-48aa-8090-de114e6f1cea req-04fc6864-95c2-4684-931c-41fd74e4efde service nova] Creating event network-changed:e613f8bc-8de6-4b77-bfee-c36f3c4c5106 for instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 on hv-cinder-81565 May 12 20:38:29.376834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.382106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.385486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.385934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.390728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-96d7c79e-35fa-48aa-8090-de114e6f1cea req-04fc6864-95c2-4684-931c-41fd74e4efde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258857 May 12 20:38:29.392891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 28/64] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:29.523309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:29.536402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:29.537042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:29.556006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-70d35592-f1ce-4f7d-aebe-d539462e40ab tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1300 microversion: 2.1 time: 0.211848 May 12 20:38:29.563565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 37/65] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:29 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:29.567638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.568317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.569311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.571941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.780992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:29.791210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:29.802575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.803410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:29.804399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:29.805453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.196087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.215505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e391b190-33e2-4348-9d01-467400612435 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.688711 May 12 20:38:30.215505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 29/66] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:29 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:30.216989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:30.217832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:30.227830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.228652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.230855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.231779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.463390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.474624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9ed96d11-bd65-4c50-a58b-fe1c631ab6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.701431 May 12 20:38:30.494945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 38/67] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:29 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:30.501448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.512813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.514521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.516123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a49731b2-854e-44ce-821d-ef2a397b0eb0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.306484 May 12 20:38:30.516874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 30/68] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:30 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:30.571181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-a1156ed8-b301-41f8-95ec-cf61baebe4c7 req-292b48b4-b617-4f88-aa1a-64146a160a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:30.576477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:30.577675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:30.580487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-a1156ed8-b301-41f8-95ec-cf61baebe4c7 req-292b48b4-b617-4f88-aa1a-64146a160a47 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.580953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-a1156ed8-b301-41f8-95ec-cf61baebe4c7 req-292b48b4-b617-4f88-aa1a-64146a160a47 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.584963 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.585653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.586428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.586928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.616066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-a1156ed8-b301-41f8-95ec-cf61baebe4c7 req-292b48b4-b617-4f88-aa1a-64146a160a47 service nova] Creating event network-changed:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:38:30.616623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-a1156ed8-b301-41f8-95ec-cf61baebe4c7 req-292b48b4-b617-4f88-aa1a-64146a160a47 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 20:38:30.617845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.618335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:30.623340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:30.640335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.compute.rpcapi [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 20:38:30.641353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=129358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 20:38:30.674913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3edbf69c-1ae1-45ca-99e5-1cd5c65e65b5 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112880 May 12 20:38:30.676278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 39/69] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:30.681987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:30.688107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-39a11523-06e8-4a74-9871-bfc494f0eacf tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1298 microversion: 2.1 time: 0.115916 May 12 20:38:30.688992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 31/70] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:30 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:31.231236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:31.231918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:31.238845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.239374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.240836 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.241534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.399507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:31.407259 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-415a4ccc-761a-4f38-921d-5c302c5e2096 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.180416 May 12 20:38:31.407767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 40/71] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:31 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:31.432494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-f9ba3982-6f58-42f2-b3f3-ff98c1cf97f1 req-3d64ca69-e890-439b-a8ef-947c5a59ccd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac2486e-2cc0-43d2-b384-4249cab22a41", "tag": "1ac9c000-2052-4024-bbe2-b690193142dd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:31.440938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f9ba3982-6f58-42f2-b3f3-ff98c1cf97f1 req-3d64ca69-e890-439b-a8ef-947c5a59ccd3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.441421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f9ba3982-6f58-42f2-b3f3-ff98c1cf97f1 req-3d64ca69-e890-439b-a8ef-947c5a59ccd3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.452559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-f9ba3982-6f58-42f2-b3f3-ff98c1cf97f1 req-3d64ca69-e890-439b-a8ef-947c5a59ccd3 service nova] Creating event network-changed:1ac9c000-2052-4024-bbe2-b690193142dd for instance eac2486e-2cc0-43d2-b384-4249cab22a41 on hv-cinder-81565 May 12 20:38:31.457565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-f9ba3982-6f58-42f2-b3f3-ff98c1cf97f1 req-3d64ca69-e890-439b-a8ef-947c5a59ccd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029072 May 12 20:38:31.458149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 32/72] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:31.492382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:31.493088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:31.535711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.535711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.535711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.535711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.542469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:31.544304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:31.552651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.553111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.554041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.554366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.642495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:31.649764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d56dbcd4-e002-481c-9450-40f7abc52ec4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.161122 May 12 20:38:31.650330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 41/73] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:31 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:31.705547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:31.706160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:31.707926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:31.711986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.712438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.713204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:31.713673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:31.716822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:31.718343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:31.719451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6168980e-fa82-4368-8e10-e346fa7db8f3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.187290 May 12 20:38:31.720011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 33/74] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:31 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:32.155464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:32.181138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f1bec261-1d3d-4ae2-a898-34da7b3857d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.479283 May 12 20:38:32.181771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 42/75] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:31 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:32.426915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:32.427965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:32.437481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:32.462783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:32.463782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:32.464281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:32.672270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:32.673576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:32.709398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:32.715490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:32.715490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:32.715490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:32.967511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:32.975980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a42cc9a2-b625-4da7-9baa-ec17cf7b485f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.555159 May 12 20:38:32.976562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 34/76] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:32 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:33.002030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:33.002651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:33.029706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:33.031129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:33.031129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:33.031371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:33.203929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:33.220197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-adbc2c0d-17f8-4f23-b06a-98c2d20d4b22 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.550863 May 12 20:38:33.233096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 43/77] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:32 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:33.243078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:33.243799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:33.260009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:33.260498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:33.261309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:33.263589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:33.555336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:33.564278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-09146fa2-a072-493c-923e-1edad0306cc9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.329915 May 12 20:38:33.566284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 44/78] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:33 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:33.671132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:33.679387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:33.681157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:33.682353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4f56d685-1702-47af-822a-f11a6ff5caf8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.704823 May 12 20:38:33.682915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 35/79] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:32 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:33.996095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:33.997009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:34.004185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.004638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.005697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.006334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.240875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.247012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:34.249602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:34.266389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-db4d2dae-a935-48f6-82ae-2eeecdf4c8a4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.276009 May 12 20:38:34.272971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 45/80] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:33 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:34.273083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.273546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.274746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.275630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.375515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-3557b770-6d5d-4388-9378-2b1549d2dce6 req-6cb96196-729b-430f-8a54-7f910661266c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5aa200-1fb8-4cde-b379-333b9b415aef", "tag": "98d4851d-d441-40c6-8745-4065b6b18a3d"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:34.401006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3557b770-6d5d-4388-9378-2b1549d2dce6 req-6cb96196-729b-430f-8a54-7f910661266c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.401479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3557b770-6d5d-4388-9378-2b1549d2dce6 req-6cb96196-729b-430f-8a54-7f910661266c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.421698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-3557b770-6d5d-4388-9378-2b1549d2dce6 req-6cb96196-729b-430f-8a54-7f910661266c service nova] Creating event network-changed:98d4851d-d441-40c6-8745-4065b6b18a3d for instance 8d5aa200-1fb8-4cde-b379-333b9b415aef on hv-cinder-81565 May 12 20:38:34.430019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-3557b770-6d5d-4388-9378-2b1549d2dce6 req-6cb96196-729b-430f-8a54-7f910661266c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058407 May 12 20:38:34.431142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 46/81] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:38:34.500933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.509441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-062a3f00-228c-42fd-acff-0d4b56c1bb1c tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.273464 May 12 20:38:34.510279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 36/82] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:34 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:34.584283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:34.584930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:34.592244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.592691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.593474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.593905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.702292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:34.703504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:34.712498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.712977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.713769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:34.714226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:34.734872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.742015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-96658c84-3bab-4f56-8fd9-a29d330116d5 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.163218 May 12 20:38:34.742761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 47/83] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:34 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:34.876361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.884717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.886280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:34.888155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af166b4a-3674-400f-877e-44ee459de845 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.192168 May 12 20:38:34.888718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 37/84] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:34 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:35.289433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:35.298650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:35.328959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.331051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.331940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.332609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.411327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-77ffdfdb-5a18-49e6-8a45-0f9e3fd8cda9 req-5769f6e8-6021-4cae-b528-a944aacf7cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac2486e-2cc0-43d2-b384-4249cab22a41", "name": "network-vif-plugged", "status": "completed", "tag": "1ac9c000-2052-4024-bbe2-b690193142dd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:35.424634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-77ffdfdb-5a18-49e6-8a45-0f9e3fd8cda9 req-5769f6e8-6021-4cae-b528-a944aacf7cb0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.425948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-77ffdfdb-5a18-49e6-8a45-0f9e3fd8cda9 req-5769f6e8-6021-4cae-b528-a944aacf7cb0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.439779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-77ffdfdb-5a18-49e6-8a45-0f9e3fd8cda9 req-5769f6e8-6021-4cae-b528-a944aacf7cb0 service nova] Creating event network-vif-plugged:1ac9c000-2052-4024-bbe2-b690193142dd for instance eac2486e-2cc0-43d2-b384-4249cab22a41 on hv-cinder-81565 May 12 20:38:35.445899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-77ffdfdb-5a18-49e6-8a45-0f9e3fd8cda9 req-5769f6e8-6021-4cae-b528-a944aacf7cb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154094 May 12 20:38:35.447396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 38/85] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:35.529158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:35.530169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:35.537575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.538568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.539553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.540131 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.563100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:35.592901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4130e7a9-087b-49d9-906f-896e3ad0bbe0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.297978 May 12 20:38:35.593592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 48/86] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:35 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:35.759983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:35.761980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:35.768918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.770090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.772196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.773883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.798531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:35.809262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-02e399fb-77fc-4b87-b0b7-c46535f80faf tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.285478 May 12 20:38:35.842885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 39/87] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:35 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:35.906470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:35.907159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:35.913759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.914309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:35.915144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:35.915639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:36.031631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.041516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5145834f-8129-4c76-b4fd-23dc3a7b36f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.284624 May 12 20:38:36.043995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 49/88] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:35 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:36.125061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.133884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.135611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.136872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e3668685-a844-4497-b9fc-b3bcc6b04d7c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.234605 May 12 20:38:36.137811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 40/89] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:35 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:36.610717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:36.611332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:36.617695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:36.618191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:36.618990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:36.619425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:36.762150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.769815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0fd4224e-db6a-4db6-8a25-d77c3805f7e9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.163005 May 12 20:38:36.770398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 50/90] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:36 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:36.829159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:36.829845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:36.836166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:36.836622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:36.837480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:36.837924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:36.984212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:36.991487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-653b4ebc-6981-4f4e-919f-72593943d74e tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.166230 May 12 20:38:36.996790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 41/91] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:36 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:37.062242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:37.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:37.071264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.071942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.073118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.074506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.157945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:37.158928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:37.165132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.165622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.166402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.166839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.221061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:37.228820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ecd0bab0-df70-4563-87a2-1c7a2f747d6e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.172721 May 12 20:38:37.229434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 51/92] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:37 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:37.335616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:37.340046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:37.342681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:37.344281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-95e64f3f-d173-4dd9-86e4-7db4590a90b1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.191777 May 12 20:38:37.344994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 42/93] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:37 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:37.471149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6", "name": "network-vif-plugged", "status": "completed", "tag": "41b33746-5b6f-4d2a-882a-9333fb8eee47"}, {"server_uuid": "7f0a63ea-b229-4fd8-afd1-e8d6c28c1248", "name": "network-vif-plugged", "status": "completed", "tag": "e613f8bc-8de6-4b77-bfee-c36f3c4c5106"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:37.489780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.490944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.506980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] Creating event network-vif-plugged:41b33746-5b6f-4d2a-882a-9333fb8eee47 for instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 on hv-cinder-81565 May 12 20:38:37.507818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] Creating event network-vif-plugged:e613f8bc-8de6-4b77-bfee-c36f3c4c5106 for instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 on hv-cinder-81565 May 12 20:38:37.517341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-b58b6ff5-5076-450d-a195-e6792145faac req-05b32e56-bee1-4248-9faf-1281b339bb2c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054209 May 12 20:38:37.518022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 52/94] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:37.791852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:37.792816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:37.800442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.800898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:37.801752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:37.802182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.015343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:38.015343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:38.033414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.033877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.034657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.036086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.065007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.078213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-98dcc500-578f-4761-ba5c-4ba0dd990fdd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1322 microversion: 2.1 time: 0.294232 May 12 20:38:38.079274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 43/95] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:37 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:38.203280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.210578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a6d4fa37-cde6-47c7-b45d-0c0774f5eb6f tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.202036 May 12 20:38:38.219943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 53/96] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:38 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:38.246123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:38.246927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:38.253130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.253610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.254370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.254975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.362174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:38.362896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:38.370335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.370870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.372398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:38.373385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:38.408604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.416245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-208d7c6b-453b-4f78-b841-1a91d72d0239 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.173754 May 12 20:38:38.417391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 44/97] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:38 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:38.542603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.550495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.551999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:38.553105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-79b7b56c-fe6a-4e98-835f-6dea8f5bd50d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.194815 May 12 20:38:38.553696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 54/98] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:38 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:39.096541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:39.097741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.104137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.104901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.106506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.107225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.228019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:39.228705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.237382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.237822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.238614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.239050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.356579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.367110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-63dcd8e7-8792-44d7-9556-521cb8dbeaa1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1516 microversion: 2.1 time: 0.273768 May 12 20:38:39.368517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 45/99] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:39 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:39.395104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:39.396239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.403565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.404115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.405016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.405603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.420204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.428060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f0e260a3-13cd-4485-b552-c9f4323e867a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1314 microversion: 2.1 time: 0.203849 May 12 20:38:39.433601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 55/100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:39 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:39.437814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:39.438695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.448174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.448774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.450767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.451202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.482798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'flavor' on Instance uuid eac2486e-2cc0-43d2-b384-4249cab22a41 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:38:39.628325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.638048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-42d39165-ba3b-40f3-b3f6-7d7573347c7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.204861 May 12 20:38:39.638652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 56/101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:39 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:39.648007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-1c242ba6-b90a-478a-8202-bb3c11ebf1aa req-f1e0df09-9d5b-4aa2-97b3-5f84c2808d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "name": "network-vif-plugged", "status": "completed", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:39.651739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-1c242ba6-b90a-478a-8202-bb3c11ebf1aa req-f1e0df09-9d5b-4aa2-97b3-5f84c2808d62 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.652324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-1c242ba6-b90a-478a-8202-bb3c11ebf1aa req-f1e0df09-9d5b-4aa2-97b3-5f84c2808d62 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.663663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-1c242ba6-b90a-478a-8202-bb3c11ebf1aa req-f1e0df09-9d5b-4aa2-97b3-5f84c2808d62 service nova] Creating event network-vif-plugged:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:38:39.670772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-1c242ba6-b90a-478a-8202-bb3c11ebf1aa req-f1e0df09-9d5b-4aa2-97b3-5f84c2808d62 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029407 May 12 20:38:39.670772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 57/102] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:39.674875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:39.676039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.681960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.682479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.684544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.684986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.825591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.833636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.835438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:39.836705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28d8d32a-9bcf-460a-95cf-faad7b8e0f0a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.165641 May 12 20:38:39.837251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 58/103] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:39 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:39.963255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-da92ef6e-2984-4f4f-90fe-798272b57b7d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41/action" status: 200 len: 32 microversion: 2.1 time: 0.577853 May 12 20:38:39.968981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 46/104] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:38:39 2022] POST /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41/action => generated 32 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:38:39.973177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:39.973816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:39.983319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.983998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:39.985026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:39.985633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.128341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:40.135516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-523677fa-0707-4806-88db-3b68f05dacb9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.165997 May 12 20:38:40.136076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 59/105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:39 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:40.447801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:40.448619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:40.455854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.456501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.457291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.458006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.638563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:40.647814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-812ea40c-dce5-4189-a035-08d5140b9c58 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1502 microversion: 2.1 time: 0.203646 May 12 20:38:40.662211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 47/106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:40 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:40.667429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:40.668205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:40.674808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.675260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.676457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.676963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.855981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:40.857025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:40.864038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:40.867321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.868470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.869579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:40.870167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:40.874936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7768d682-760c-46f3-ba53-2840b24fe1c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.212183 May 12 20:38:40.877846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 60/107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:40 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:41.161984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:41.162647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:41.171804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:41.172252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:41.173022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:41.173489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:41.279738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:41.289916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:41.296354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:41.297895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e541cf63-8a4b-424e-bdda-3c7377270d78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.446998 May 12 20:38:41.298609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 48/108] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:40 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:41.414367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:41.423243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f057de3f-8a6a-4074-9480-e9ae85c66507 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.265303 May 12 20:38:41.424002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 61/109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:41 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:41.686062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-837f4aaa-37ff-4534-8ff8-a156bb24125f req-b14262d7-4e5d-49ec-859b-bfacce5100d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5aa200-1fb8-4cde-b379-333b9b415aef", "name": "network-vif-plugged", "status": "completed", "tag": "98d4851d-d441-40c6-8745-4065b6b18a3d"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:41.701923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-837f4aaa-37ff-4534-8ff8-a156bb24125f req-b14262d7-4e5d-49ec-859b-bfacce5100d5 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:41.702384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-837f4aaa-37ff-4534-8ff8-a156bb24125f req-b14262d7-4e5d-49ec-859b-bfacce5100d5 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:41.717961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-837f4aaa-37ff-4534-8ff8-a156bb24125f req-b14262d7-4e5d-49ec-859b-bfacce5100d5 service nova] Creating event network-vif-plugged:98d4851d-d441-40c6-8745-4065b6b18a3d for instance 8d5aa200-1fb8-4cde-b379-333b9b415aef on hv-cinder-81565 May 12 20:38:41.721401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-837f4aaa-37ff-4534-8ff8-a156bb24125f req-b14262d7-4e5d-49ec-859b-bfacce5100d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 May 12 20:38:41.722413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 49/110] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:41.892910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:41.893547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:41.899418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:41.899726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:41.900493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:41.900930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.056127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:42.064214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2aff54e3-d16a-4964-a5f1-c82d3318d739 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.175098 May 12 20:38:42.065024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 62/111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:41 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:42.319706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:42.320647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:42.333838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.334293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.340854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.340854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.452551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:42.457308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:42.476525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.476970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.477767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.478202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.512266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:42.520463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:42.522137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:42.523309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cbe0336a-3fc4-4dc8-960c-f09e270a7cb3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.209305 May 12 20:38:42.527863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 50/112] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:42 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:38:42.647893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:42.657099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e6ae394b-2743-45af-afe0-6e7ecdeaa1cd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.217902 May 12 20:38:42.658187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 63/113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:42 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:42.810729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21f4ce31-3855-4544-ad5e-06c10f2b2451"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:42.811791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:42.818263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.818783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:42.819556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:42.819990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.082393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:43.082393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:43.087758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.088202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.088965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.089954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.247957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:43.268863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dcbda9a8-957f-4839-b2fe-20d8b606ed04 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.191340 May 12 20:38:43.273625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 64/114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:43 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:43.542706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:43.543273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:43.549294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.550688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.550688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.551095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.680656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:43.688538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:43.690087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:43.691188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2b92ec81-f7d5-4cbf-9666-f6379dc361d6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.152482 May 12 20:38:43.691744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 65/115] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:43 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:43.696148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:43.696956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:43.703418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.703991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.704755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:43.705191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:43.848507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:43.856834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c63b76b7-99cb-455c-9c38-3ea9f1a783ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.163934 May 12 20:38:43.858339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 66/116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:43 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:44.285985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:44.287286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:44.294005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.294561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:44.295557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.296165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:44.486230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:44.493568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0cc16bfc-ff5f-47aa-9100-7312f4e44f33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.211497 May 12 20:38:44.494141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 67/117] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:44 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:44.710207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:44.710844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:44.718527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.718970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:44.719734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.720159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:44.932979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:44.943234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:44.944716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:44.945974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a9ef8587-3c9a-4349-ac5e-db5f4b81d6e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1407 microversion: 2.20 time: 0.239720 May 12 20:38:44.946670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 68/118] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:44 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:44.952326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:44.952923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:44.959460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.959905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:44.960775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:44.961212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:45.175621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:45.185688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7a87c5d1-adca-4b14-9b48-aa4539dd8ae8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.237821 May 12 20:38:45.186569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 69/119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:44 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:45.514648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:45.516117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:45.523209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:45.524525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:45.525577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:45.527324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:45.681380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:45.689054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f2e5a97c-f0dd-4400-ab7e-75b988c43deb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.178742 May 12 20:38:45.690735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 70/120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:45 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:45.964036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:45.965246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:45.971117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:45.971569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:45.972332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:45.972851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.104587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:46.112962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:46.114823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:46.116045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-19bb8ffa-893a-4f2d-880d-224f5a106b4c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1599 microversion: 2.20 time: 0.155898 May 12 20:38:46.116824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 71/121] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:38:45 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:38:46.134982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:46.135521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:46.142183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.142629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.143564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.144006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.263049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-43b07806-352a-400e-8d90-2b240da49252 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131880 May 12 20:38:46.263649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 72/122] 10.222.0.59 () {60 vars in 1315 bytes} [Thu May 12 20:38:46 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 20:38:46.278118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:46.279718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:46.286614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.287348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.288131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.288569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.453057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:46.461522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-aa4e9794-5d83-473e-87cd-b7d20c2866b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.190990 May 12 20:38:46.462299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 73/123] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:46 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:46.707746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:46.708419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:46.716500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.716946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.717735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:46.718164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:46.847155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:46.854791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7b5037ff-7d10-42cd-bf20-6495c224da29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.150790 May 12 20:38:46.856557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 74/124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:46 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:47.479029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:47.479912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:47.486125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:47.486564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:47.487323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:47.487867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:47.636999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:47.644539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6be3d6b2-6d27-4d12-8df6-33a211332876 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.169450 May 12 20:38:47.645106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 75/125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:47 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:47.817669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-4f209cd5-de33-4a6e-b7c4-e13363c56cf6 req-1313f5f9-9e3c-400b-a157-27a5624dc418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:47.826821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-4f209cd5-de33-4a6e-b7c4-e13363c56cf6 req-1313f5f9-9e3c-400b-a157-27a5624dc418 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:47.827277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-4f209cd5-de33-4a6e-b7c4-e13363c56cf6 req-1313f5f9-9e3c-400b-a157-27a5624dc418 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:47.838373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-4f209cd5-de33-4a6e-b7c4-e13363c56cf6 req-1313f5f9-9e3c-400b-a157-27a5624dc418 service nova] Creating event network-changed:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:38:47.843603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-4f209cd5-de33-4a6e-b7c4-e13363c56cf6 req-1313f5f9-9e3c-400b-a157-27a5624dc418 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029495 May 12 20:38:47.844312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 76/126] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:38:47.873769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:47.874491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:47.881230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:47.881704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:47.882461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:47.882890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:48.037777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:48.047104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d1d8700-b283-4262-abfd-ba44c7c07671 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.178713 May 12 20:38:48.048486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 77/127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:47 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:48.662419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:48.663025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:48.670296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:48.670733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:48.672127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:48.672717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:48.818052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:48.827359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d922c329-a210-404b-a1c0-05ddc4138401 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.169092 May 12 20:38:48.863463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 78/128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:48 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:49.015529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-96772181-d222-4c22-a39b-a87d5cc48da3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "POST /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.209474 May 12 20:38:49.017348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 51/129] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:38:42 2022] POST /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6/os-volume_attachments => generated 194 bytes in 6212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:49.064832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:49.065756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:49.074740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:49.074740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:49.075104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:49.075724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:49.235978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:49.243435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a92e3ed-a150-4693-8137-eb84d6ac06c4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1365 microversion: 2.1 time: 0.182503 May 12 20:38:49.244137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 79/130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:49 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:49.851764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:49.852589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:49.859609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:49.860069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:49.860855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:49.861310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:50.013539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:50.021382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9b378233-7567-4ded-a8da-d2945e702281 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.174188 May 12 20:38:50.022203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 52/131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:49 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:50.261414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:50.262014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:50.267830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:50.268214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:50.268964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:50.269437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:50.397650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:50.405061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8caeb53a-4e1e-450e-a9a3-a01a64f334b0 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1556 microversion: 2.1 time: 0.147985 May 12 20:38:50.405647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 80/132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:50 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:50.422910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:50.425340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:50.429211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:50.429695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:50.430462 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:50.430901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:50.508271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c7b37120-4c0e-44e1-b1bf-c9cdb9b4c17b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089404 May 12 20:38:50.508871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 53/133] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:38:50 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:51.038552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:51.039161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:51.046773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:51.047227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:51.048026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:51.048502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:51.412669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:51.427747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9fea48db-87be-4990-8eb5-4d8b416c934b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.392979 May 12 20:38:51.428314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 81/134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:51 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:52.103553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-a0e2886a-90c1-46a2-8b5e-d590dc24470e req-646c80af-9bfb-4d02-9842-510481c62d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5aa200-1fb8-4cde-b379-333b9b415aef", "tag": "98d4851d-d441-40c6-8745-4065b6b18a3d"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:38:52.112313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-a0e2886a-90c1-46a2-8b5e-d590dc24470e req-646c80af-9bfb-4d02-9842-510481c62d95 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:52.112767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-a0e2886a-90c1-46a2-8b5e-d590dc24470e req-646c80af-9bfb-4d02-9842-510481c62d95 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:52.125370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-a0e2886a-90c1-46a2-8b5e-d590dc24470e req-646c80af-9bfb-4d02-9842-510481c62d95 service nova] Creating event network-changed:98d4851d-d441-40c6-8745-4065b6b18a3d for instance 8d5aa200-1fb8-4cde-b379-333b9b415aef on hv-cinder-81565 May 12 20:38:52.130465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-a0e2886a-90c1-46a2-8b5e-d590dc24470e req-646c80af-9bfb-4d02-9842-510481c62d95 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031111 May 12 20:38:52.131056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 54/135] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:38:52.446977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:52.447697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:52.454454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:52.454892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:52.455644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:52.456073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:52.591835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:52.599399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9eb2371e-1f34-4989-a0e9-aa98f4a6a335 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.156419 May 12 20:38:52.599954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 82/136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:52 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:53.618371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:53.619064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:53.625895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:53.626361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:53.627370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:53.627802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:53.768811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:53.776150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5f90f88c-9af4-4a91-b1cd-ac59103b2159 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.162612 May 12 20:38:53.777483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 55/137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:53 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:54.795518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:54.796183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:54.802063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:54.802505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:54.803264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:54.804994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:54.941715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:54.949106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ac42f55b-8ccc-47e1-a21f-b3c022e7f0be tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.158867 May 12 20:38:54.949948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 83/138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:54 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:55.966245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:55.967571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:55.974159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:55.974613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:55.975562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:55.976006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:56.111953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:56.119573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7987825a-1ab7-4628-bccd-f4c1d9b1b6e1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.157372 May 12 20:38:56.120914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 56/139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:55 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:57.143067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:57.143067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:57.148294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:57.148750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:57.149585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:57.150021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:57.290811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:57.292166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d8ab4ea2-6c2b-4d0c-bfe7-db719a25494d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.158823 May 12 20:38:57.292738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 84/140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:57 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:58.309451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:58.310021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:58.316385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:58.316834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:58.317637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:58.318074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:58.533776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:58.541200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd224c7a-f0be-4172-80bd-2cc3fd99d77b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.235770 May 12 20:38:58.541800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 57/141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:58 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:38:59.401730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:59.402855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:59.408862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.409335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.410280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.410716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.437859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:38:59.558373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:59.560004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:59.566596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.572391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.572391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.572391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.703896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:59.711976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-920a2ab6-874e-45a3-bc96-7fdbf572c4ce tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.157622 May 12 20:38:59.712547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 58/142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:59 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:38:59.781337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8aa9a4c0-eec2-49ee-b463-23ba6ac8854d tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "DELETE /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 204 len: 0 microversion: 2.1 time: 0.383024 May 12 20:38:59.781913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 85/143] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:38:59 2022] DELETE /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:38:59.790485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:38:59.791109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:38:59.797554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.798008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.798779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:38:59.799215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:38:59.932757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:38:59.941943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c96d2da2-dc49-441c-82e9-ea7a2a1555f8 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1554 microversion: 2.1 time: 0.155604 May 12 20:38:59.942516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 59/144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:38:59 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:00.729431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:00.730286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:00.736687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:00.737135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:00.737994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:00.738422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:00.882992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:00.890965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cc5b4109-d9a9-49e4-b8f1-0cfbe3f6821e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.165707 May 12 20:39:00.900287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 86/145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:00 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:00.959768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:00.960509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:00.967922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:00.968381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:00.969166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:00.969610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:01.341307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:01.349731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ed96bb21-be4a-4543-b0ea-55b2eddda130 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1554 microversion: 2.1 time: 0.393755 May 12 20:39:01.350302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 60/146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:00 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1554 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:01.908292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:01.908902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:01.914709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:01.915153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:01.915914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:01.916339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:02.052377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:02.059621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-271590df-e521-4e1e-862b-02c858f4f963 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.155733 May 12 20:39:02.060187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 87/147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:01 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:02.367534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:02.368899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:02.376319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:02.376789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:02.377974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:02.378410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:02.508031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:02.516382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-927da06e-164c-4122-95b3-a52dcd16903a tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1554 microversion: 2.1 time: 0.153076 May 12 20:39:02.516888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 61/148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:02 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:03.077909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:03.078987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:03.086088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:03.086535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:03.087302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:03.087735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:03.227092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:03.235801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6dcc1aed-dd5c-454e-8b64-97b715ddb4c4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.162393 May 12 20:39:03.237805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 88/149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:03 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:03.533848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:03.534486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:03.540804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:03.541248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:03.542033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:03.542464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:03.674116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:03.681762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f7614e16-81ef-4230-a4d5-1b04ebe3737b tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1554 microversion: 2.1 time: 0.153015 May 12 20:39:03.682484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 62/150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:03 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:04.252934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:04.253504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:04.259460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:04.259912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:04.260666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:04.261098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:04.388168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:04.396051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6aadca30-b8b4-4832-8f1c-a6abb569c38c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.147412 May 12 20:39:04.396623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 89/151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:04 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:04.699251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:04.699864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:04.707140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:04.707587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:04.708351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:04.708787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:04.846802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:04.854612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e32ce272-92f7-4f24-acdd-512a7b16d6d3 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1554 microversion: 2.1 time: 0.159191 May 12 20:39:04.855183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 63/152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:04 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:05.190345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-5da8bdc1-67b0-443c-93d8-d24afa293e66 req-5967ff53-e3aa-4798-93fb-3625720a3089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "41b33746-5b6f-4d2a-882a-9333fb8eee47"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:05.206786 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5da8bdc1-67b0-443c-93d8-d24afa293e66 req-5967ff53-e3aa-4798-93fb-3625720a3089 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.207275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5da8bdc1-67b0-443c-93d8-d24afa293e66 req-5967ff53-e3aa-4798-93fb-3625720a3089 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.219793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-5da8bdc1-67b0-443c-93d8-d24afa293e66 req-5967ff53-e3aa-4798-93fb-3625720a3089 service nova] Creating event network-vif-unplugged:41b33746-5b6f-4d2a-882a-9333fb8eee47 for instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 on hv-cinder-81565 May 12 20:39:05.226262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-5da8bdc1-67b0-443c-93d8-d24afa293e66 req-5967ff53-e3aa-4798-93fb-3625720a3089 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040141 May 12 20:39:05.227024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 90/153] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:39:05.413645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:05.414517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:05.420374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.420824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.421623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.422074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.565025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:05.572591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a224762a-fbf0-4eb9-ae53-b64ac40c2000 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.162886 May 12 20:39:05.577192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 64/154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:05 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:05.706996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-cff7484b-fc56-4c02-b2ac-ccec4f49f098 req-2b3616c0-5797-420b-9676-6b849dfe985e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6", "name": "network-vif-deleted", "tag": "41b33746-5b6f-4d2a-882a-9333fb8eee47"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:05.716594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-cff7484b-fc56-4c02-b2ac-ccec4f49f098 req-2b3616c0-5797-420b-9676-6b849dfe985e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.717029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-cff7484b-fc56-4c02-b2ac-ccec4f49f098 req-2b3616c0-5797-420b-9676-6b849dfe985e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.728084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-cff7484b-fc56-4c02-b2ac-ccec4f49f098 req-2b3616c0-5797-420b-9676-6b849dfe985e service nova] Creating event network-vif-deleted:41b33746-5b6f-4d2a-882a-9333fb8eee47 for instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 on hv-cinder-81565 May 12 20:39:05.733575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-cff7484b-fc56-4c02-b2ac-ccec4f49f098 req-2b3616c0-5797-420b-9676-6b849dfe985e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031994 May 12 20:39:05.737124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 91/155] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:05.872152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:05.872784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:05.880872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.881967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.883142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:05.883791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:05.953523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:05.962085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-48a50ed6-cfd1-4836-ae4f-3bf6afe22f34 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1345 microversion: 2.1 time: 0.093788 May 12 20:39:05.962654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 65/156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:05 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:06.591418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:06.592114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:06.605608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:06.610086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:06.610086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:06.610086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:06.747102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:06.755987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b39aad62-e6c1-4eca-bd6c-dd1c1cb7d072 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.168692 May 12 20:39:06.758813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 92/157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:06 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:06.979224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:06.979835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:06.986432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:06.986905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:06.987635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:06.988069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:07.029716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:07.030177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:07.030639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lazy-loading 'fault' on Instance uuid 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:39:07.077830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0034ea4df67849d193d6fabca6395773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca3db22ad6a4c14a5e86696a8cb43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:07.086418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-926b61d2-a196-4e56-9938-6c90991a1235 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 200 len: 1350 microversion: 2.1 time: 0.110958 May 12 20:39:07.087000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 66/158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:06 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:07.774390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:07.777154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:07.780766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:07.781211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:07.782033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:07.782449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:07.930982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:07.940189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b6cccd74-d1fb-43ab-b445-14c1e2e491fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.169472 May 12 20:39:07.940706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 93/159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:07 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:08.107380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:08.108141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:08.115949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.116561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:08.117526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.118083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:08.134574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] HTTP exception thrown: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Request method failure captured: May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 HTTP/1.1 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAlkbaiqbLpepiV4FV4Xvnw41iFk1DcZRlNFXprUAK5XC9FrZDQaubEI0KzV87W_WkR79fSXkqLeiDL3d2zRHupr6BuZ7M4UZRAhzUt83X8HBwlhNj5k6b8TiSj1VzkGt4YXjl3DfSKqzpGPjErZVgs6_E9jn1w2A4tLOeT0Tuv_aw May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:39:08.147890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ca3db22ad6a4c14a5e86696a8cb43f9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 0034ea4df67849d193d6fabca6395773 May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.149454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6'} May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:08.150260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.151737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:08.152898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Returning 404 to user: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:08.152898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8a2c2a2f-3eb1-4b7b-bb6b-62b5fe353961 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 404 len: 111 microversion: 2.1 time: 0.050000 May 12 20:39:08.152898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 67/160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:08 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 20:39:08.449496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:08.450499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:08.464398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.464398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:08.464727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.465163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:08.483671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] HTTP exception thrown: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Request method failure captured: May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6/os-volume_attachments HTTP/1.1 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAlkbaiqbLpepiV4FV4Xvnw41iFk1DcZRlNFXprUAK5XC9FrZDQaubEI0KzV87W_WkR79fSXkqLeiDL3d2zRHupr6BuZ7M4UZRAhzUt83X8HBwlhNj5k6b8TiSj1VzkGt4YXjl3DfSKqzpGPjErZVgs6_E9jn1w2A4tLOeT0Tuv_aw May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:39:08.489013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ca3db22ad6a4c14a5e86696a8cb43f9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 0034ea4df67849d193d6fabca6395773 May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.490347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': '58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6'} May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:08.491057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:08.492172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:08.493408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Returning 404 to user: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:08.493408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-526c989f-4260-4297-9302-34eaa8574420 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045046 May 12 20:39:08.493408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 94/161] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:39:08 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:39:08.956708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:08.957585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:08.963635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.964180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:08.965014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:08.965481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:09.120996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:09.129221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b88639c4-d307-40b2-b02b-92a92ea669fc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.176770 May 12 20:39:09.130027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 68/162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:08 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:09.949199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:09.949789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:09.956911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:09.957788 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:09.959111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:09.965053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:09.987370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] HTTP exception thrown: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Request method failure captured: May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 HTTP/1.1 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAlkbaiqbLpepiV4FV4Xvnw41iFk1DcZRlNFXprUAK5XC9FrZDQaubEI0KzV87W_WkR79fSXkqLeiDL3d2zRHupr6BuZ7M4UZRAhzUt83X8HBwlhNj5k6b8TiSj1VzkGt4YXjl3DfSKqzpGPjErZVgs6_E9jn1w2A4tLOeT0Tuv_aw May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:39:09.989727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ca3db22ad6a4c14a5e86696a8cb43f9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 0034ea4df67849d193d6fabca6395773 May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:09.990841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6'} May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:09.991464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:09.996208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:09.997234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Returning 404 to user: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:09.997234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd0f7bb1-10a4-4755-9f85-47ad428bed04 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "DELETE /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 404 len: 111 microversion: 2.1 time: 0.046307 May 12 20:39:09.997234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 95/163] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:39:09 2022] DELETE /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:39:10.000042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:10.000721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] [instance: 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:10.008448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:10.008940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:10.009708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:10.010141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:10.024829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] HTTP exception thrown: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Request method failure captured: May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 HTTP/1.1 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAlkbaiqbLpepiV4FV4Xvnw41iFk1DcZRlNFXprUAK5XC9FrZDQaubEI0KzV87W_WkR79fSXkqLeiDL3d2zRHupr6BuZ7M4UZRAhzUt83X8HBwlhNj5k6b8TiSj1VzkGt4YXjl3DfSKqzpGPjErZVgs6_E9jn1w2A4tLOeT0Tuv_aw May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:39:10.026549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1ca3db22ad6a4c14a5e86696a8cb43f9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1ca3db22ad6a4c14a5e86696a8cb43f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 1ca3db22ad6a4c14a5e86696a8cb43f9 May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038014868 May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 0034ea4df67849d193d6fabca6395773 May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-DeleteServersTestJSON-1038014868-project May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:10.028065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6'} May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:10.028810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. May 12 20:39:10.029885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:39:10.030795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] Returning 404 to user: Instance 58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:10.030795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-11ef1a90-0555-4567-9ffb-90fac944c1f4 tempest-DeleteServersTestJSON-1038014868 tempest-DeleteServersTestJSON-1038014868-project] 10.222.0.59 "GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6" status: 404 len: 111 microversion: 2.1 time: 0.031817 May 12 20:39:10.030795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 69/164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:09 2022] GET /compute/v2.1/servers/58d3ce2c-4ee8-49c6-98b3-43f6f29cc8f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:39:10.147121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:10.148353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:10.154271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:10.154782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:10.155886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:10.157182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:10.669559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:10.677213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-841ae92c-ef87-4f43-810f-07a068de16c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.534542 May 12 20:39:10.678136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 96/165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:10 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:11.694367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:11.694972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:11.705349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:11.705349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:11.705349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:11.705349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:11.894770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:11.902623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f5dce21b-d57f-4bc5-9a28-4750bf3c8b0d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.211962 May 12 20:39:11.905762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 70/166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:11 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:12.923498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:12.924114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:12.930385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:12.930827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:12.931583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:12.932137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:13.074178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:13.083579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ec7d536c-9f41-492d-a419-9c03b7c8091b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.164540 May 12 20:39:13.084511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 97/167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:12 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:14.101632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:14.102243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:14.110656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:14.111668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:14.112958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:14.113812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:14.313851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:14.320990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-73adbd4d-51d5-43a5-89ad-5dfd67d82d09 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.223344 May 12 20:39:14.321863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 71/168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:14 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:15.339611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:15.341167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:15.348314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:15.348959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:15.355438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:15.355438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:15.534341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:15.542868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0cdb3b93-dc7f-475e-b65d-d5704b679ff1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.207035 May 12 20:39:15.546136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 98/169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:15 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:16.563764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:16.564876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:16.572409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:16.572977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:16.573889 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:16.574871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:16.811609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:16.823641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-738b83e3-12a1-4bb3-a475-8559b219ed0e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.263208 May 12 20:39:16.834564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 72/170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:16 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:17.841387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:17.842637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:17.848808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:17.849716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:17.851566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:17.853933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:18.015160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:18.023519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2270f754-8136-4588-8575-ea8c1fb1bfe9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1522 microversion: 2.1 time: 0.185948 May 12 20:39:18.024083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 99/171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:17 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:19.039831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:19.040448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:19.046880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:19.048144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:19.049123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:19.049590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:19.517340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:19.538361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9e0f9619-3c05-4608-8191-06790b275df5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1502 microversion: 2.1 time: 0.490410 May 12 20:39:19.540704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 73/172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:19 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:19.561170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:19.562040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:19.573150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:19.573150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:19.573798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:19.574229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:19.886342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:19.903600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-94f41d42-f2fe-443f-ad5a-e03b674314b1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1515 microversion: 2.1 time: 0.340967 May 12 20:39:19.908322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 100/173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:19 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:20.609828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1410084056", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "networks": [{"uuid": "92474127-dc6d-46a4-ba68-071a1f22e7be"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:20.698084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] validate_networks() for [('92474127-dc6d-46a4-ba68-071a1f22e7be', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:39:21.441647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:39:21.442158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:39:21.442716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:39:21.443203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:39:21.443691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:39:21.462826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:21.464561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:21.467675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:21.467675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:21.528802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Getting quotas for project 43069e4b5d394dc4a733cf11628eac72. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:21.536895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Getting quotas for user eb3a1cc28fbe48b18d0fd19415cd7a53 and project 43069e4b5d394dc4a733cf11628eac72. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:21.572736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:39:21.576219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:39:21.789131 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cd9c1722-3997-455b-9130-bb56fe12de2f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184666 May 12 20:39:21.793241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 74/174] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:39:21.800511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9432d775-7c6b-46e5-9982-a9db40971b4e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:21.801139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9432d775-7c6b-46e5-9982-a9db40971b4e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:21.905516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9432d775-7c6b-46e5-9982-a9db40971b4e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:21.925407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9432d775-7c6b-46e5-9982-a9db40971b4e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1214 microversion: 2.1 time: 0.129589 May 12 20:39:21.928720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 101/175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:21 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:22.347887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:22.349260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:22.381515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:22.382742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:22.383554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:22.384001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:22.432432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'flavor' on Instance uuid 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:39:22.947123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9b42b914-02ac-4cb5-84a1-4107db7ab5d3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:22.948396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9b42b914-02ac-4cb5-84a1-4107db7ab5d3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:23.042443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9b42b914-02ac-4cb5-84a1-4107db7ab5d3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:23.052735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9b42b914-02ac-4cb5-84a1-4107db7ab5d3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1214 microversion: 2.1 time: 0.110552 May 12 20:39:23.054768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 102/176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:22 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:23.066826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2021da8e-5f3c-4845-b143-e4df92b6b4ea tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/action" status: 200 len: 32 microversion: 2.1 time: 0.743737 May 12 20:39:23.068831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 75/177] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:39:22 2022] POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/action => generated 32 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:39:23.080078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:23.081115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:23.088843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:23.090280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:23.092776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:23.092776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:23.313068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:23.337543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4ff7ae99-ff69-42b0-a7ce-bb02465ef644 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.263037 May 12 20:39:23.346717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8b23d31a-2019-448a-bc92-c8dee7b93787 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: .version_select at 0x7f4e680b6820>, body: {"keypair": {"name": "tempest-keypair-1692626225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAb2ydZWvH5nppgd+pB1s38PARk5+ZFoGY8XwJQ+FPrNP7GGHxJAlgaKsT80B9tuc7awUgCLvqFpTV1FtBOGrPq7JAhtvAjzl+dRuUtOlbGSfJ7YtInhWyaUF1vFy+zKBg=="}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:23.353388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 103/178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:23 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:23.381616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-8b23d31a-2019-448a-bc92-c8dee7b93787 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for project 726b268af80347bbbf58e80cef5c61bc. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:23.387327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-8b23d31a-2019-448a-bc92-c8dee7b93787 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for user e3fa08cd466c419e80198a5b44b719f9 and project 726b268af80347bbbf58e80cef5c61bc. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:23.462589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8b23d31a-2019-448a-bc92-c8dee7b93787 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.327438 May 12 20:39:23.463290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 76/179] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:39:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:39:24.070682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:24.071211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:24.079075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:24.079812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:24.086620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:24.086620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:24.193257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:24.215412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-70692d4d-f94f-49fd-8d1d-e4b1b9d998e4 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1266 microversion: 2.1 time: 0.136046 May 12 20:39:24.215412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 104/180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:24 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:24.371770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:24.373361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:24.382336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:24.382877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:24.383726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:24.384376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:24.563839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:24.571842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0a2dd679-4151-4e41-a153-36f53bdd1ef7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.205752 May 12 20:39:24.578640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 77/181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:24 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:25.223699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:25.224838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:25.231156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:25.231845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:25.234839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:25.235494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:25.387557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:25.399916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-24275199-8647-48ee-8c20-82896957fb4a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1274 microversion: 2.1 time: 0.177521 May 12 20:39:25.400536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 105/182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:25 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:25.590521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:25.591145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:25.603398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:25.604215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:25.605338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:25.606049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:25.802798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:25.813110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7b417c5d-78be-4062-bbbe-418b914ffac9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.226501 May 12 20:39:25.814093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 78/183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:25 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:26.404341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2141239679", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59ab41f8-7e85-4688-bb20-32bdbdb0f9ea"}], "security_groups": [{"name": "tempest-securitygroup--1638090432"}], "key_name": "tempest-keypair-1692626225", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:26.418858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:26.419534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:26.428887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.429379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:26.430323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.430940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:26.526819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:26.528001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] validate_networks() for [('59ab41f8-7e85-4688-bb20-32bdbdb0f9ea', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:39:26.535244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4a533370-d76d-4198-940d-8317cc9fb993 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1274 microversion: 2.1 time: 0.120625 May 12 20:39:26.535821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 79/184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:26 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:26.834613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:26.835342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:26.849170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.849897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:26.851152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.851600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:26.954900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:39:26.957029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:39:26.957555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:39:26.957976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:39:26.958404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:39:26.979526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.980097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:26.981013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:26.981566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:27.000359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for project 726b268af80347bbbf58e80cef5c61bc. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:27.005464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for user e3fa08cd466c419e80198a5b44b719f9 and project 726b268af80347bbbf58e80cef5c61bc. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:27.012942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:27.018079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:39:27.020696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:39:27.026968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d3cd3083-e922-4eeb-be31-e1e7ebb943b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.199877 May 12 20:39:27.027556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 80/185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:26 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:27.179513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-aab133a3-96bb-4fae-9785-b098c287562e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779434 May 12 20:39:27.181179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 106/186] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:39:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:39:27.191344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5246fa5a-0c85-49ae-8f31-b43ff7a6ea9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:27.191965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5246fa5a-0c85-49ae-8f31-b43ff7a6ea9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:27.556833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:27.558214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:27.565578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:27.566502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:27.567019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:27.567479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:27.591680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5246fa5a-0c85-49ae-8f31-b43ff7a6ea9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:27.615667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5246fa5a-0c85-49ae-8f31-b43ff7a6ea9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1238 microversion: 2.1 time: 0.428611 May 12 20:39:27.631526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 81/187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:27 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1238 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:27.654275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:27.662345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-87455a25-2396-4674-8eeb-92793a3987de tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1284 microversion: 2.1 time: 0.112443 May 12 20:39:27.662916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 107/188] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:27 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:28.045873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:28.047694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:28.054968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.055655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.056441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.056885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.272768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:28.281613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-be98313b-f54b-4e42-a174-b6c9fae8dc11 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.239434 May 12 20:39:28.282391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 82/189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:28 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:28.648338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:28.648981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:28.654997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.655447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.656414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.656886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.680313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:28.680921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:28.687391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.687880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.688638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:28.689124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:28.721563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:28.728907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2ee28471-0c18-4229-aceb-6f78869fe9c7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1242 microversion: 2.1 time: 0.084662 May 12 20:39:28.729508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 108/190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:28 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:28.823966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:28.832042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3bf80f32-87b5-41d3-9c6a-ab6c1f30487b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.156020 May 12 20:39:28.832608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 83/191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:28 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:29.299775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:29.300679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:29.307180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.307703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.308538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.308993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.439152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:29.446549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dbcf403b-e16a-41c2-a24e-5628604f1942 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.151769 May 12 20:39:29.447126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 109/192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:29 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:29.729338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-091c2d8c-c0f3-461e-980b-bf2d8bae9ab3 req-86a3724f-d994-4c49-a6db-ebb0ec5ccc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a2214c-465b-4b35-b2c7-de21d89ef845", "tag": "47b24fe9-45ce-4df3-9bd2-45bc10686be5"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:29.738785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-091c2d8c-c0f3-461e-980b-bf2d8bae9ab3 req-86a3724f-d994-4c49-a6db-ebb0ec5ccc4e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.742842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-091c2d8c-c0f3-461e-980b-bf2d8bae9ab3 req-86a3724f-d994-4c49-a6db-ebb0ec5ccc4e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.746036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:29.746900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:29.753814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-091c2d8c-c0f3-461e-980b-bf2d8bae9ab3 req-86a3724f-d994-4c49-a6db-ebb0ec5ccc4e service nova] Creating event network-changed:47b24fe9-45ce-4df3-9bd2-45bc10686be5 for instance 05a2214c-465b-4b35-b2c7-de21d89ef845 on hv-cinder-81565 May 12 20:39:29.754005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.754391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.755650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.755650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.759452 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-091c2d8c-c0f3-461e-980b-bf2d8bae9ab3 req-86a3724f-d994-4c49-a6db-ebb0ec5ccc4e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033822 May 12 20:39:29.760040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 84/193] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:29.820194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:29.828041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-58b13865-2083-4626-8359-1c85acf01a5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1290 microversion: 2.1 time: 0.085930 May 12 20:39:29.828510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 110/194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:29 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:29.855890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:29.857525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:29.868867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.869414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:29.870207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:29.871356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:30.087357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:30.103199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-657a7351-855e-48c0-9ce3-c19f474812b3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.249258 May 12 20:39:30.104107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 85/195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:29 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:30.463923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:30.464812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:30.470945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:30.471495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:30.472343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:30.472852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:30.664073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:30.675800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-651a75c7-2c79-45ca-828c-e84f08f3690b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.215652 May 12 20:39:30.676760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 111/196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:30 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:30.846341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:30.847738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:30.854204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:30.854659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:30.855453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:30.856289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:30.949671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:30.957755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c4936a04-97ed-409f-a4f2-ad9695234115 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1296 microversion: 2.1 time: 0.116193 May 12 20:39:30.967477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 86/197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:30 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:31.121234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:31.121234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:31.129169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.129651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:31.130423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.130856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:31.274345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:31.281931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e11da6dd-3672-4c13-8c0d-a4fbb92034c2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.165848 May 12 20:39:31.282526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 112/198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:31 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:31.694682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:31.695594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:31.703617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.707793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:31.707793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.707793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:31.938051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:31.945244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-89c5ccd0-5728-497a-98c7-d0a4a93266f8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.255341 May 12 20:39:31.945834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 87/199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:31 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:31.978422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:31.979028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:31.985948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.986396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:31.987154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:31.987598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:32.137839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:32.145669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-83d4fb53-b2f1-4319-a5d0-4c7cb7a12ef0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.171061 May 12 20:39:32.146305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 113/200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:31 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:32.299283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:32.299837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:32.310690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:32.311520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:32.314303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:32.315061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:32.488889 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:32.496043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b237eae2-1fae-48ac-8371-a6165e073e02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.201458 May 12 20:39:32.496606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 88/201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:32 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:32.962854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:32.963467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:32.970105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:32.970555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:32.971317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:32.971752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.102254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:33.110403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-230d3875-bf16-40c7-bf4e-3abdd369b199 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.151266 May 12 20:39:33.111082 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 114/202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:32 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:33.162258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:33.162871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:33.169663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.170110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.170869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.171344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.313663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:33.320878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7165037f-0041-4172-a84d-0801b46377c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.162465 May 12 20:39:33.321801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 89/203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:33 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:33.373576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:33.374078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:33.380585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.381028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.381913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.382343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.405086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7a756530-bac7-4e60-912f-d9a3771a3e24 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/ips" status: 200 len: 152 microversion: 2.20 time: 0.035392 May 12 20:39:33.405960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 115/204] 10.222.0.59 () {60 vars in 1288 bytes} [Thu May 12 20:39:33 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:39:33.512537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:33.513159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:33.519663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.520117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.521047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:33.521340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:33.696619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:33.704212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a54ff5d9-a1c3-4499-92c9-5de4d5691457 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.195570 May 12 20:39:33.705024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 90/205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:33 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:34.127525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:34.128513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:34.134784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.135237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.136078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.136481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.269741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:34.277805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5e98b5e2-3157-4573-89e5-de9e88513e9c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.154168 May 12 20:39:34.278497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 116/206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:34 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:34.338750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:34.339359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:34.347249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.347727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.349531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.349531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.539313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:34.547768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d375df1b-71eb-41d0-9b5e-05ec277841bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.212737 May 12 20:39:34.548513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 91/207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:34 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:34.719950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:34.720566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:34.727168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.727553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.728472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:34.728917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:34.928141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:34.935639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8241933e-4d0d-49cc-becb-409c86a5f200 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.219557 May 12 20:39:34.947877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 117/208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:34 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:35.295444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:35.296671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:35.302823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.303493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:35.304325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.304850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:35.564970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:35.565779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:35.572512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.572968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:35.573764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.574188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:35.741835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:35.752220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c2dd25f6-fc1d-40ff-a9c2-d81bd3c59709 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.191839 May 12 20:39:35.763301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 118/209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:35 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:35.855223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:35.870191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-579cd679-0c27-4e88-a88b-c6adfa9c423f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.578635 May 12 20:39:35.880567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 92/210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:35 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:35.955306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:35.957849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:35.964496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.965094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:35.966018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:35.966531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:36.111096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:36.118653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-98d292ee-6c00-4c11-9ad2-e6fcdbc3e063 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.167832 May 12 20:39:36.119560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 119/211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:35 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:36.170726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-5c3370ae-9886-493f-98c3-0283605943b8 req-1ed43b64-7f5d-4c80-856f-51468db8a3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbc0365-6647-411e-9225-26ead37c724d", "tag": "b94b2dd5-2c01-445f-ab87-f2c09a146bfa"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:36.184824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c3370ae-9886-493f-98c3-0283605943b8 req-1ed43b64-7f5d-4c80-856f-51468db8a3f3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:36.185301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c3370ae-9886-493f-98c3-0283605943b8 req-1ed43b64-7f5d-4c80-856f-51468db8a3f3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:36.204457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-5c3370ae-9886-493f-98c3-0283605943b8 req-1ed43b64-7f5d-4c80-856f-51468db8a3f3 service nova] Creating event network-changed:b94b2dd5-2c01-445f-ab87-f2c09a146bfa for instance 0fbc0365-6647-411e-9225-26ead37c724d on hv-cinder-81565 May 12 20:39:36.221013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-5c3370ae-9886-493f-98c3-0283605943b8 req-1ed43b64-7f5d-4c80-856f-51468db8a3f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054401 May 12 20:39:36.222146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 93/212] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:36.348929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:36.349520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:36.355878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:36.356328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:36.357091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:36.357722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:36.382915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lazy-loading 'flavor' on Instance uuid a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:39:36.772407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:36.773123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:36.780320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:36.781590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:36.782379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:36.782816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.190488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.198431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ec3d9cc0-d234-42b2-aaca-8b7612aeffcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.430424 May 12 20:39:37.199144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 94/213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:36 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:37.213814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:37.214567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:37.222308 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.223041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.223859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.224294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.270466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a85473d-3a66-4cd6-8f01-7464da969cc2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/action" status: 202 len: 0 microversion: 2.20 time: 0.925481 May 12 20:39:37.275107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 120/214] 10.222.0.59 () {62 vars in 1318 bytes} [Thu May 12 20:39:36 2022] POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 20:39:37.280640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:37.281877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:37.293096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.293096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.293096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.293096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.459391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.474368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-99b502b3-65fc-4338-998e-a19b55321ae5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.197896 May 12 20:39:37.475332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 121/215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:37 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:37.487736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:37.488614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:37.495927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.496567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.497535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:37.497973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:37.588309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.601620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a87cac7f-63cb-4e86-bad3-3afad87d25b3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.401056 May 12 20:39:37.602443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 95/216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:37 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:37.655044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.664557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.666319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:37.668357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-baa53c44-2c73-4374-9403-9109f28cb8a6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.186055 May 12 20:39:37.669005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 122/217] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:37 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:38.216143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:38.216752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:38.225096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.225579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.226519 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.226951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.449952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:38.459792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f2794709-ea85-4784-aeae-a8a15322b505 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.247468 May 12 20:39:38.461523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 96/218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:38 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:38.492035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:38.492641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:38.499357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.500569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.501647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.502338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.620629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:38.621239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:38.636503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.637743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.639572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.648374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.679290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:38.688377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dfd48b0b-38eb-4cfc-ab5b-c9f8f4db5d02 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.199873 May 12 20:39:38.688969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 123/219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:38 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:38.703333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:38.704181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:38.710969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.711420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.712359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:38.712795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:38.883883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:38.892402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:38.893922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:38.895059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-da2aca8c-5ce7-45c9-b865-baa6ae5b6dcd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.203228 May 12 20:39:38.895608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 124/220] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:38 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:39.011496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:39.019925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-291a2dae-f652-401d-813e-08e29199691e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.403005 May 12 20:39:39.021158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 97/221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:38 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:39.478694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:39.479542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:39.489485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.490198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.491298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.491960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.708714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:39.709525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:39.741658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:39.750170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d79723f7-909e-41b1-ba12-627d760ec1b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.275062 May 12 20:39:39.750736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 125/222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:39 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:39.752153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.754288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.757297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.760343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.800768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-0fb75716-7338-4d5f-86e8-7f4cc29ba752 req-4b830feb-9768-4fd3-87d6-67d93fbd9ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2214c-465b-4b35-b2c7-de21d89ef845", "name": "network-vif-plugged", "status": "completed", "tag": "47b24fe9-45ce-4df3-9bd2-45bc10686be5"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:39.814071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-0fb75716-7338-4d5f-86e8-7f4cc29ba752 req-4b830feb-9768-4fd3-87d6-67d93fbd9ccf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.814751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-0fb75716-7338-4d5f-86e8-7f4cc29ba752 req-4b830feb-9768-4fd3-87d6-67d93fbd9ccf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.835494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-0fb75716-7338-4d5f-86e8-7f4cc29ba752 req-4b830feb-9768-4fd3-87d6-67d93fbd9ccf service nova] Creating event network-vif-plugged:47b24fe9-45ce-4df3-9bd2-45bc10686be5 for instance 05a2214c-465b-4b35-b2c7-de21d89ef845 on hv-cinder-81565 May 12 20:39:39.842075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-0fb75716-7338-4d5f-86e8-7f4cc29ba752 req-4b830feb-9768-4fd3-87d6-67d93fbd9ccf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045644 May 12 20:39:39.844460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 126/223] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:39:39.915434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:39.918650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:39.941114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.941615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:39.945608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:39.946114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:40.066990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:40.085415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-83623367-b029-4cf7-8232-02350d1623ad tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.383085 May 12 20:39:40.091384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 98/224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:39 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:40.116262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:40.117023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:40.127629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:40.128445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:40.129351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:40.129868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:40.226430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:40.235327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:40.236835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:40.238027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3041f900-c72f-47c8-a4a0-abdff5139513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.329021 May 12 20:39:40.239003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 127/225] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:39 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:40.447976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:40.456671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-512c133c-f313-4462-9a0c-37ae9b8ce1f3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.362250 May 12 20:39:40.463930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 99/226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:40 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:40.769303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:40.770619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:40.780247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:40.781546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:40.782515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:40.783116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.108918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:41.113855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:41.119940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.122127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.122973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.123569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.144830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.154605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8e502360-0a91-43bc-8e6c-0fb4797376f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.390521 May 12 20:39:41.162300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 128/227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:40 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:41.267031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:41.272681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:41.298097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.298546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.310372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.310843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.402542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.412570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53a39bc2-4959-4638-82a2-2f9402173e3b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.307925 May 12 20:39:41.423338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 100/228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:41 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:41.474470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:41.475101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:41.492440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.492440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.492440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:41.492440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:41.551216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.565708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.567576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.569144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-03121511-7c44-483c-b1b2-dd09799eda60 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.316461 May 12 20:39:41.569972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 129/229] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:41 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:41.677060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:41.688887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b7f56c21-0346-4f7b-9e31-13e10602c1e2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.218880 May 12 20:39:41.690924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 101/230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:41 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:42.172240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:42.172864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:42.180194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.181164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.182235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.182837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.324222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.333749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a52346e9-d3db-4a56-a2d0-60de7a985446 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.165333 May 12 20:39:42.334586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 130/231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:42 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:42.441306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:42.442661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:42.453443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.454145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.455172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.455758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.587966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:42.591579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:42.599508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.600131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.601245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.601705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.663814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.673168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dd68d68a-a2ee-4404-be8d-ddf535626be6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1314 microversion: 2.1 time: 0.238162 May 12 20:39:42.673873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 102/232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:42 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:42.709816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:42.710679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:42.724512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.726117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.727814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:42.728424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:42.776104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.786010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.787801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.788960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a016ac08-3fd7-4dac-a0df-8308a428a4b3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.204774 May 12 20:39:42.794562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 131/233] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:42 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:42.967367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:42.992125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-abff5957-f700-40c6-b0d6-1ad30050198a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.286075 May 12 20:39:42.995780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 103/234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:42 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:43.352654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:43.353268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:43.364882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.365355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.366140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.371716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.587255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:43.596439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-94015ff3-41ed-4234-a0fa-af1009aad88f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.248791 May 12 20:39:43.597011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 132/235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:43 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:43.691657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:43.692768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:43.699699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.700066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.700842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.701477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.807600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:43.808237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:43.820348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.821241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.822054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:43.822496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:43.888691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:43.898981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-37177e1c-d711-42b0-92c2-aed2d867575f tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1498 microversion: 2.1 time: 0.212472 May 12 20:39:43.900232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 104/236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:43 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1498 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:44.009944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:44.010555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:44.018181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.018630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.019395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.019826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.053934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:44.064308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:44.066531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:44.067939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-526e13e9-8fc7-4928-b561-8e602d7105b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.264285 May 12 20:39:44.081587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 133/237] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:43 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:39:44.176006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:44.183863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70e66881-2b80-41bb-bd8b-f6f71361b84b tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1501 microversion: 2.1 time: 0.177775 May 12 20:39:44.184670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 105/238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:44 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:44.205405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6150039a-0a21-4a96-b7b7-67d79428f1ae"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:44.206903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:44.214526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.214974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.216051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.216488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.243566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] HTTP exception thrown: Cannot 'attach_volume' instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 while it is in vm_state rescued May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Request method failure captured: May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/os-volume_attachments HTTP/1.1 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 74 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz1nlroBCS0z9CAFGhOAWRaQrvgY3sdBRyvmLUWpqZRCr4DZ6SqTkMaldH6lEflE8tNJvN1W1-kIe50dc6LkQB5FPvsJXGfRn5qbZZoiBz9xG66YcTprXNYFPtttmGCcDp8kjNkb4tAvIbUatUy3rwt0HG1EU_iza49vMuuHTKSQw May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:39:44.245324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_500b58188f1a4a088b52b67eb5772984", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 2a2b95ccb7804311a011f37ccb371771 May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {"volumeAttachment": {"volumeId": "6150039a-0a21-4a96-b7b7-67d79428f1ae"}} May 12 20:39:44.246818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Cannot 'attach_volume' instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 while it is in vm_state rescued May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': '7f0a63ea-b229-4fd8-afd1-e8d6c28c1248', 'body': {'volumeAttachment': {'volumeId': '6150039a-0a21-4a96-b7b7-67d79428f1ae'}}} May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:44.247644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 while it is in vm_state rescued May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:44.249076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 while it is in vm_state rescued May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Returning 409 to user: Cannot 'attach_volume' instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 while it is in vm_state rescued {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f9c53cdd-b29b-40da-9372-cfc784bb431d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046549 May 12 20:39:44.251775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 134/239] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:39:44 2022] POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 20:39:44.258963 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:44.260408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:44.267494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.267952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.268727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.269386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.415810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-849572dc-3ffa-4897-bc0c-38a5d81e3b56 req-d1bb90a2-9c46-45e1-a2f0-544adfd59f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbc0365-6647-411e-9225-26ead37c724d", "name": "network-vif-plugged", "status": "completed", "tag": "b94b2dd5-2c01-445f-ab87-f2c09a146bfa"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:44.428414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-849572dc-3ffa-4897-bc0c-38a5d81e3b56 req-d1bb90a2-9c46-45e1-a2f0-544adfd59f4a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.428978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-849572dc-3ffa-4897-bc0c-38a5d81e3b56 req-d1bb90a2-9c46-45e1-a2f0-544adfd59f4a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.447860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-849572dc-3ffa-4897-bc0c-38a5d81e3b56 req-d1bb90a2-9c46-45e1-a2f0-544adfd59f4a service nova] Creating event network-vif-plugged:b94b2dd5-2c01-445f-ab87-f2c09a146bfa for instance 0fbc0365-6647-411e-9225-26ead37c724d on hv-cinder-81565 May 12 20:39:44.457525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-849572dc-3ffa-4897-bc0c-38a5d81e3b56 req-d1bb90a2-9c46-45e1-a2f0-544adfd59f4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 May 12 20:39:44.458884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 135/240] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:39:44.546966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c0bc8323-fc1a-4893-bed7-9f3a442b06e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/action" status: 202 len: 0 microversion: 2.1 time: 0.291142 May 12 20:39:44.551313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 106/241] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:39:44 2022] POST /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:39:44.561228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:44.562132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:44.576121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.578529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.579497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.580098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.629588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:44.641828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:44.658556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.659229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:44.660987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:44.661557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.024548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.035752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-54d8223a-1ee1-4b57-8cd2-2263cd3b6bab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.425232 May 12 20:39:45.039361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 107/242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:44 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:39:45.060443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:45.061451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:45.069000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.071526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.072474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.075491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.155888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:39:45.259694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.270643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e065dbe5-9dea-4323-bc45-9664b2864e39 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1509 microversion: 2.1 time: 0.716314 May 12 20:39:45.271551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 136/243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:44 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1509 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:45.284167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:45.285117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:45.296560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.296979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.297799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.298235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.580313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.588713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.596325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.600715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-68badfe4-d13c-418b-9c44-74bda73aaeea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.325341 May 12 20:39:45.602754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 137/244] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:45 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:45.655805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-17096e8f-3337-41c1-a59d-68b1712b8c66 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "DELETE /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 204 len: 0 microversion: 2.1 time: 0.598688 May 12 20:39:45.656597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 108/245] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:39:45 2022] DELETE /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:39:45.672821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:45.673468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:45.682951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.685262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.686274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:45.687445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:45.908897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:45.923037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1c931004-29b4-4d2f-9dab-ca86a44804e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1504 microversion: 2.1 time: 0.254109 May 12 20:39:45.923037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 138/246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:45 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:46.063668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:46.064505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:46.071411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.074884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.075432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.075985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.277295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:46.284279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-98c6b56a-be99-4a5c-afdc-f91c32b3c742 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.225607 May 12 20:39:46.284893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 109/247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:46 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:46.289179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:46.290057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:46.300051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.300582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.301540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.301979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.597743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:46.612730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-52127d10-5b11-4297-a3f3-5b04d610acd1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1509 microversion: 2.1 time: 0.328686 May 12 20:39:46.613337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 139/248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:46 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:46.631636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:46.632375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:46.638879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.639323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.641064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.641565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.795557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:46.804682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:46.806171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:46.807425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e4a03a4d-7959-4368-a2b3-ab100c1e610e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.181267 May 12 20:39:46.807995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 110/249] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:46 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:46.940881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:46.941528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:46.951770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.951966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:46.955625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:46.956074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.148576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:47.169222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-995eaaa6-7cf9-4bed-9072-8afcd27918ed tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1504 microversion: 2.1 time: 0.233859 May 12 20:39:47.173949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 140/250] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:46 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:47.301861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:47.302657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:47.319277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.319648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.320471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.321175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.397860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:47.398358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:47.406329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.406803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.407572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.408065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.483027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-07b35039-336a-498a-b49f-bd6074fd48ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/ips" status: 200 len: 150 microversion: 2.1 time: 0.088938 May 12 20:39:47.493262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 141/251] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:39:47 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/ips => generated 150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:47.630891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:47.632197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:47.658011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:47.672574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0f641ff4-6189-4580-9a66-303a07672283 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1364 microversion: 2.1 time: 0.369257 May 12 20:39:47.672985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.673871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.675856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.676242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 111/252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:47 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:47.676560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.832248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:47.832839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:47.841369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.842116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:47.843158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:47.843780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.031278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.049993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.051692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.052902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a93f20f6-ed85-4576-b2ae-6647c38a6617 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.227980 May 12 20:39:48.053775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 112/253] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:47 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:48.188001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:48.188628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:48.215250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.215674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.221173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.221662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.294014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.304464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-85e91e12-1376-48ac-b135-3130ec6457de tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1509 microversion: 2.1 time: 0.677544 May 12 20:39:48.307212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 142/254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:47 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1509 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:48.466532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.477916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7685ad2d-31da-427e-8586-5b897215d8c3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1504 microversion: 2.1 time: 0.294944 May 12 20:39:48.478504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 113/255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:48 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:48.691252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:48.692027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:48.699980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.716580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.719453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.722903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.929222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:48.938072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cb8851ea-efef-4df3-adca-d369ef0a43e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1551 microversion: 2.1 time: 0.250691 May 12 20:39:48.939362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 143/256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:48 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1551 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:48.958955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:48.959408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:48.967941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.968582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:48.969437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:48.974140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.033403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-fd59459b-e472-4564-9ae7-cc0795ddd932 req-3a3281f5-8a7c-4d6c-85ac-e3fe53f3a1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2214c-465b-4b35-b2c7-de21d89ef845", "name": "network-vif-deleted", "tag": "47b24fe9-45ce-4df3-9bd2-45bc10686be5"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:49.048427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-fd59459b-e472-4564-9ae7-cc0795ddd932 req-3a3281f5-8a7c-4d6c-85ac-e3fe53f3a1ae service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.049228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-fd59459b-e472-4564-9ae7-cc0795ddd932 req-3a3281f5-8a7c-4d6c-85ac-e3fe53f3a1ae service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.080928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-fd59459b-e472-4564-9ae7-cc0795ddd932 req-3a3281f5-8a7c-4d6c-85ac-e3fe53f3a1ae service nova] Creating event network-vif-deleted:47b24fe9-45ce-4df3-9bd2-45bc10686be5 for instance 05a2214c-465b-4b35-b2c7-de21d89ef845 on hv-cinder-81565 May 12 20:39:49.107325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-fd59459b-e472-4564-9ae7-cc0795ddd932 req-3a3281f5-8a7c-4d6c-85ac-e3fe53f3a1ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067673 May 12 20:39:49.107706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-59106cd3-054a-43f3-9da9-102b2380e447 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143884 May 12 20:39:49.107706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 114/257] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:39:48 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:49.108011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 144/258] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:39:49.108094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:49.108094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:49.118708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.121812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.125802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.126445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.323267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:49.324459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:49.336316 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.337157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.339245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.345849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.565090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:49.582909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:49.587467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:49.590977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-822ec236-62b5-452f-ac33-852b12b48775 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.490109 May 12 20:39:49.607555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 115/259] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:49 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:49.612643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:49.613291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:49.651627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.653118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.653991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.654430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.798439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:49.806626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-deeb9923-ffb8-4960-a234-f3784772ec68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1509 microversion: 2.1 time: 0.487488 May 12 20:39:49.807560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 145/260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:49 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:49.813126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30023ea7-f857-4266-94e3-a9fcb233d89f"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:49.814465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:49.821025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.828598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:49.829725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:49.830505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:50.027466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:50.039862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ce4a0ef-54ec-4333-a614-22cda0ede83e tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1299 microversion: 2.1 time: 0.429752 May 12 20:39:50.048685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 116/261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:49 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1299 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:50.616001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:50.616616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:50.623928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:50.624788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:50.626038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:50.628207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:50.896240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:50.904119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:50.905720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:50.907177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8a0d68cd-7ac1-48f6-9681-9484b467e4e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.296368 May 12 20:39:50.907895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 117/262] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:50 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:39:50.913630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:50.914393 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:50.945219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:50.946365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:50.948362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:50.948831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.150501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:51.169579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f37a0eef-c730-46c3-a2ad-aa77d5078c07 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1515 microversion: 2.1 time: 0.260158 May 12 20:39:51.180854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 118/263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:50 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:51.188308 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:51.191993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:51.212145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.214307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.217104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.219218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.290723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.291176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.294159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 05a2214c-465b-4b35-b2c7-de21d89ef845 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:39:51.456767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:51.464806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-21aba592-31fd-4e90-9ee9-9ccdd91535cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 200 len: 1304 microversion: 2.1 time: 0.282646 May 12 20:39:51.465656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 119/264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:51 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 1304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:51.470997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-de1f4b1f-480b-4ab2-89c7-f4ceaa27dd4c req-a624566b-cca1-4036-8a30-404d7b2606c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbc0365-6647-411e-9225-26ead37c724d", "tag": "b94b2dd5-2c01-445f-ab87-f2c09a146bfa"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:51.479479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-de1f4b1f-480b-4ab2-89c7-f4ceaa27dd4c req-a624566b-cca1-4036-8a30-404d7b2606c9 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.479962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-de1f4b1f-480b-4ab2-89c7-f4ceaa27dd4c req-a624566b-cca1-4036-8a30-404d7b2606c9 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.492544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-de1f4b1f-480b-4ab2-89c7-f4ceaa27dd4c req-a624566b-cca1-4036-8a30-404d7b2606c9 service nova] Creating event network-changed:b94b2dd5-2c01-445f-ab87-f2c09a146bfa for instance 0fbc0365-6647-411e-9225-26ead37c724d on hv-cinder-81565 May 12 20:39:51.499378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-de1f4b1f-480b-4ab2-89c7-f4ceaa27dd4c req-a624566b-cca1-4036-8a30-404d7b2606c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031641 May 12 20:39:51.500249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 120/265] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:51.535125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-214b0f91-5f36-4f23-800f-059956d1872d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.725654 May 12 20:39:51.542410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 146/266] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:39:49 2022] POST /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments => generated 194 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:51.928893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:51.930259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:51.939616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.942001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:51.945996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:51.945996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:52.431123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:52.444622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:52.448096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:52.449649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f29be9c-0503-4cad-a752-41b9388387ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.525404 May 12 20:39:52.462430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 121/267] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:51 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:52.484124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:52.484124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 05a2214c-465b-4b35-b2c7-de21d89ef845] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:52.491249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:52.491703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:52.492486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:52.495084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:52.529135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] HTTP exception thrown: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Request method failure captured: May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 HTTP/1.1 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXB2wqGkucCf9GQI4j7mFx3G14rxG8k-JJRNElGR5cNL_iI4ARZybH4qMBZuFVUFiS_magQNSN_7SunxmicO36S2hgJFKUAqSilnet6yVDzusjR5aBFcZFVGrGVWaspU2GZR0QYkX7svU_Ugj279ZDP-W6iyVRt7eOBoGMWIj-7fnL0 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 43069e4b5d394dc4a733cf11628eac72 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesActionsTest-1182233973 May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:39:52.531671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_43069e4b5d394dc4a733cf11628eac72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesActionsTest-1182233973 May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 43069e4b5d394dc4a733cf11628eac72 May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesActionsTest-1182233973 May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesActionsTest-1182233973-project May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: eb3a1cc28fbe48b18d0fd19415cd7a53 May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesActionsTest-1182233973-project May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. May 12 20:39:52.533237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '05a2214c-465b-4b35-b2c7-de21d89ef845'} May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:39:52.534121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. May 12 20:39:52.535913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:39:52.538417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Returning 404 to user: Instance 05a2214c-465b-4b35-b2c7-de21d89ef845 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:39:52.539440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c47af24b-16f6-4a69-a62b-9802c6ee11d2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845" status: 404 len: 111 microversion: 2.1 time: 0.062012 May 12 20:39:52.540484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 147/268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:52 2022] GET /compute/v2.1/servers/05a2214c-465b-4b35-b2c7-de21d89ef845 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:39:52.750473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-428408133", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "networks": [{"uuid": "92474127-dc6d-46a4-ba68-071a1f22e7be"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:52.862148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] validate_networks() for [('92474127-dc6d-46a4-ba68-071a1f22e7be', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:39:53.109706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f0e813a4-7015-40c8-9913-ca0b66d6f22e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: .version_select at 0x7f4e680820d0>, body: {"keypair": {"name": "tempest-keypair-470728356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsVHOJDrUaxDcL4sjRhg8g9wktDPK/2wmdHH3F46+EJE2ujn5W7kOxRJyYwu8y7LmnM5eK7bg4Nuzs5LIU7wwQJ8BB7wDyW5MgzQzIMU4YhWVKCOwgI/7tJACXRgbjqeA=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:53.132491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-f0e813a4-7015-40c8-9913-ca0b66d6f22e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for project 500b58188f1a4a088b52b67eb5772984. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:53.138206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-f0e813a4-7015-40c8-9913-ca0b66d6f22e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for user 2a2b95ccb7804311a011f37ccb371771 and project 500b58188f1a4a088b52b67eb5772984. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:53.266825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f0e813a4-7015-40c8-9913-ca0b66d6f22e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144981 May 12 20:39:53.266825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 148/269] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:39:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:53.471208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:53.471978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:53.488364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:53.494720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:53.495737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:53.500828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:53.552964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:39:53.555226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:39:53.555939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:39:53.556504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:39:53.557218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:39:53.575912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:53.579308 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:53.580440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:53.581049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:53.603487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Getting quotas for project 43069e4b5d394dc4a733cf11628eac72. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:53.609315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Getting quotas for user eb3a1cc28fbe48b18d0fd19415cd7a53 and project 43069e4b5d394dc4a733cf11628eac72. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:53.622702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:39:53.626072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:39:53.756219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:53.765311 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:53.766898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:53.768135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2519843e-7cd7-4dc0-a219-765a9c4bc0e0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.302172 May 12 20:39:53.777996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 149/270] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:53 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:39:53.953213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7948a00b-e52e-4293-95d8-35890c838015 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207257 May 12 20:39:53.953926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 122/271] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:39:53.963765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d82933d-f311-4297-bdd1-2cb95237bc89 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:53.964377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d82933d-f311-4297-bdd1-2cb95237bc89 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:54.055257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d82933d-f311-4297-bdd1-2cb95237bc89 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:54.063645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d82933d-f311-4297-bdd1-2cb95237bc89 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1213 microversion: 2.1 time: 0.103698 May 12 20:39:54.074204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 150/272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:53 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:54.788548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:54.789167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:54.810218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:54.810671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:54.812826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:54.837913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:55.081694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a4b354ed-6b63-43cc-b9e4-61fbe766d873 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:55.082319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a4b354ed-6b63-43cc-b9e4-61fbe766d873 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:55.164153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:55.176203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:55.184144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:55.190100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-91fb6542-afba-43fa-8ee4-8a2b8c3e3e49 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.403693 May 12 20:39:55.192375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 123/273] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:54 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:55.195255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a4b354ed-6b63-43cc-b9e4-61fbe766d873 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:55.204661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a4b354ed-6b63-43cc-b9e4-61fbe766d873 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1213 microversion: 2.1 time: 0.127471 May 12 20:39:55.205243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 151/274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:55 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:56.210615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:56.212511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:56.220647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:56.221268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:56.222841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:56.227259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:56.228706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:56.229340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:56.229558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:56.230015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:56.230793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:56.231227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:56.398619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:56.406050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-747e6933-0110-4cd8-9bc0-526aca3a9c39 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1265 microversion: 2.1 time: 0.189178 May 12 20:39:56.409319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 152/275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:56 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:56.520497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:56.537149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:56.538715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:56.539924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-26b6fd2d-8aa7-4916-8a85-0ad093f13172 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.333754 May 12 20:39:56.543924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 124/276] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:56 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:57.422967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:57.424208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:57.435941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:57.438105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:57.448384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:57.448384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:57.571584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:57.572125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:57.619457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:57.619457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:57.619457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:57.619457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:57.662004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:57.671654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e7eba9cb-3eb1-41aa-9e6f-1c38bb3767cd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1271 microversion: 2.1 time: 0.253124 May 12 20:39:57.676049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 153/277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:57 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:57.684587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-29229408", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "608928ff-7e35-4432-8949-a8f5a8ad9a82"}], "security_groups": [{"name": "tempest-securitygroup--1855482966"}], "key_name": "tempest-keypair-470728356", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:57.821342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] validate_networks() for [('608928ff-7e35-4432-8949-a8f5a8ad9a82', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:39:57.863021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:57.872778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:57.875109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:57.876498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8ade3809-51cc-4884-969f-d466d213453c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.308977 May 12 20:39:57.877219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 125/278] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:57 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:58.298397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:39:58.299117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:39:58.299799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:39:58.300456 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:39:58.301061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:39:58.316242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.317698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.322444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.322444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.344962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:58.349998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Getting quotas for user 2a2b95ccb7804311a011f37ccb371771 and project 500b58188f1a4a088b52b67eb5772984. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:58.363845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:39:58.366806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:39:58.525534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11b0e68f-cde2-4dd2-9b29-9c1f14287afc tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.844985 May 12 20:39:58.526247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 154/279] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:39:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:39:58.538333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8310cdc9-ea8f-4aba-ab2c-ede1dc06a3b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:58.539258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8310cdc9-ea8f-4aba-ab2c-ede1dc06a3b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:58.615137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8310cdc9-ea8f-4aba-ab2c-ede1dc06a3b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:58.622021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8310cdc9-ea8f-4aba-ab2c-ede1dc06a3b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1243 microversion: 2.1 time: 0.087621 May 12 20:39:58.622602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 126/280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:58 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:58.690747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:58.695217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:58.700907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.702409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.703558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.704318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.898352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:58.899872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:58.911346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.912069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.914525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:39:58.914525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:39:58.996066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:59.004657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-45cd36f2-727e-4988-8640-ce1c94408c1b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.320346 May 12 20:39:59.020612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 155/281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:58 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:39:59.376845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:59.391759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:59.396357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:59.406656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-93d96e23-6928-418f-9285-f279ce9da767 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1745 microversion: 2.20 time: 0.513923 May 12 20:39:59.411367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 127/282] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:39:58 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1745 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:39:59.441854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-651cee73-c4e9-49f2-a476-a242175c3e09 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: .version_select at 0x7f4e6812c700>, body: {"keypair": {"name": "tempest-keypair-266665292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiJiGRqBnR+MeMlx0XrIH4kiAUzmRJuZ+r44jDh+itizKn5UlOmMh4s5KsDLGwobXYHfg7pcUJ8ox0c2a8iAeAlnAMpYcqUQyeeUsZNojvZlBgmCMaGxygtodnVaS6JdQ=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:39:59.482459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-651cee73-c4e9-49f2-a476-a242175c3e09 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:39:59.503657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-651cee73-c4e9-49f2-a476-a242175c3e09 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:39:59.640370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d648e7a2-efee-4b56-9115-81d5ee30aefb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:39:59.641080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d648e7a2-efee-4b56-9115-81d5ee30aefb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:39:59.685792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-651cee73-c4e9-49f2-a476-a242175c3e09 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.248415 May 12 20:39:59.687865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 156/283] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:39:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:39:59.716111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d648e7a2-efee-4b56-9115-81d5ee30aefb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:39:59.724007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d648e7a2-efee-4b56-9115-81d5ee30aefb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1243 microversion: 2.1 time: 0.087838 May 12 20:39:59.724613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 128/284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:39:59 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:00.032252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:00.034942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:00.068920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.069765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.071699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.073892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.192049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-98964431-18ad-4623-bba3-ccfbcb57a7d2 req-37893a5b-8014-4fb4-bd7f-52b472260455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0998ce2c-b880-443e-8e76-98f3fc86f4ff", "tag": "932e459a-8011-49ff-85f8-bf61f4d46b2c"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:00.205098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-98964431-18ad-4623-bba3-ccfbcb57a7d2 req-37893a5b-8014-4fb4-bd7f-52b472260455 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.208604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-98964431-18ad-4623-bba3-ccfbcb57a7d2 req-37893a5b-8014-4fb4-bd7f-52b472260455 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.231844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-98964431-18ad-4623-bba3-ccfbcb57a7d2 req-37893a5b-8014-4fb4-bd7f-52b472260455 service nova] Creating event network-changed:932e459a-8011-49ff-85f8-bf61f4d46b2c for instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff on hv-cinder-81565 May 12 20:40:00.238952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-98964431-18ad-4623-bba3-ccfbcb57a7d2 req-37893a5b-8014-4fb4-bd7f-52b472260455 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049652 May 12 20:40:00.244329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 129/285] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:40:00.299925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:00.309014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ee52a0dc-8fbd-4794-bf39-5d864594ffb9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.282674 May 12 20:40:00.312843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 157/286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:00 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:00.431610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:00.432954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:00.451041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.459415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.463833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.464303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.707288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:00.715791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:00.721819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:00.723498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d293a82b-25cd-4f48-9b9a-0ffceba27625 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1745 microversion: 2.20 time: 0.297149 May 12 20:40:00.726068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 130/287] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:00 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:00.742880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:00.743543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:00.750917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.751627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.752610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:00.753525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:00.850923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:00.861681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4bd35aa1-5f23-4312-bf93-3278783e4235 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1239 microversion: 2.1 time: 0.122682 May 12 20:40:00.864189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 158/288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:00 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1239 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:01.336004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:01.342826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:01.369619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.374514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.377649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.382602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.638089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:01.638537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-a7ac69ef-19fc-4b33-9574-75fe8363764e req-1627a62f-bf5a-4211-a4df-ca73cc947ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "name": "network-vif-plugged", "status": "completed", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:01.652823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-94190d21-9350-436e-bf63-1102cd09bdbb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.324083 May 12 20:40:01.654092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 131/289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:01 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:01.657477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-a7ac69ef-19fc-4b33-9574-75fe8363764e req-1627a62f-bf5a-4211-a4df-ca73cc947ca8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.658255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-a7ac69ef-19fc-4b33-9574-75fe8363764e req-1627a62f-bf5a-4211-a4df-ca73cc947ca8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.676609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-a7ac69ef-19fc-4b33-9574-75fe8363764e req-1627a62f-bf5a-4211-a4df-ca73cc947ca8 service nova] Creating event network-vif-plugged:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:40:01.687215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-a7ac69ef-19fc-4b33-9574-75fe8363764e req-1627a62f-bf5a-4211-a4df-ca73cc947ca8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051867 May 12 20:40:01.688620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 159/290] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:40:01.743747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:01.744441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:01.752470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.753032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.754295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.754931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.880228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:01.880940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:01.891851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.892310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.893092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:01.893739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:01.966301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:01.979253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:01.981133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:01.982469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-94f6a708-801a-4935-bc00-b6d3a9640ddb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1745 microversion: 2.20 time: 0.242901 May 12 20:40:01.993366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 132/291] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:01 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1745 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:02.026961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:02.035720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-594f31e3-1529-412e-993f-5e2435d95b24 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1303 microversion: 2.1 time: 0.159882 May 12 20:40:02.048307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 160/292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:01 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:02.673969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:02.673969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:02.678481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:02.678927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:02.679688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:02.680151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:02.929775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:02.939896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bb3205f6-cb3b-4f65-b6a6-3714d541eaf3 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.273334 May 12 20:40:02.952354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 133/293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:02 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:03.001579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:03.002263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:03.013508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.014039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:03.014921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.015360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:03.052145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:03.052977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:03.068291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.068291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:03.068291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.068291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:03.288385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:03.305730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f502e75b-2827-47da-a189-47eecded8ba3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1303 microversion: 2.1 time: 0.253751 May 12 20:40:03.307113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 134/294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:03 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1303 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:03.328537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:03.331095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40059516", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8378bf4-b568-4478-81bf-9948fffba758"}], "security_groups": [{"name": "tempest-securitygroup--616070917"}], "key_name": "tempest-keypair-266665292", "user_data": "}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:03.337751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:03.339806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:03.341168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dbcf3333-5685-4f26-9b26-25b311e2f31d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.344193 May 12 20:40:03.353359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 161/295] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:02 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:03.958906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:03.959530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:03.966324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.967206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:03.970282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:03.970282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:04.287951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:04.299086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-54e9e18f-34e2-4f96-b00d-b83eb3b91ff6 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.342429 May 12 20:40:04.311970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 162/296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:03 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:04.329387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:04.330273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:04.337205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:04.337895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:04.339049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:04.339654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:04.571184 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:04.581574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8fd28503-2f0f-4700-8600-c838ebba1932 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.260201 May 12 20:40:04.596607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 163/297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:04 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:04.604627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:04.606408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:04.613658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:04.614794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:04.615789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:04.616389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:04.901960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:04.913383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:04.915137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:04.917346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cf7c0751-d134-47c9-a0ea-4d9e73e42cc6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.319366 May 12 20:40:04.918444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 164/298] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:04 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:05.318864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:05.321612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:05.349933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:05.359524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:05.359524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:05.359524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:05.737063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:05.776327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-27e590ac-79ce-4509-9da1-538cef18c7d5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.463003 May 12 20:40:05.777020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 165/299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:05 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:05.804464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:05.805785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:05.825130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:05.830075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:05.831306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:05.831964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:06.226394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:06.235560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c8c303dc-09bc-404d-81e9-e7cf71aad4b0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.457230 May 12 20:40:06.241445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 166/300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:05 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:06.254894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:06.255609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:06.323911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:06.326255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:06.328513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:06.329123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:06.564173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:06.575533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:06.580548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:06.582651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d195682-04f6-4c73-921c-281c3add588b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.339313 May 12 20:40:06.586041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 167/301] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:06 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:06.611757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-4d852bc4-20f3-4688-8440-ebe15cfababe req-731f03a7-7f90-4738-b159-cf4ec707b40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:06.626108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-4d852bc4-20f3-4688-8440-ebe15cfababe req-731f03a7-7f90-4738-b159-cf4ec707b40d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:06.626789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-4d852bc4-20f3-4688-8440-ebe15cfababe req-731f03a7-7f90-4738-b159-cf4ec707b40d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:06.649548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-4d852bc4-20f3-4688-8440-ebe15cfababe req-731f03a7-7f90-4738-b159-cf4ec707b40d service nova] Creating event network-changed:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:40:06.654866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-4d852bc4-20f3-4688-8440-ebe15cfababe req-731f03a7-7f90-4738-b159-cf4ec707b40d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056282 May 12 20:40:06.665388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 168/302] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:06.812593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:06.814506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:06.838550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:06.839064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:06.839877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:06.840367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:07.080457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:07.091083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e8180eea-75e3-4de9-bdfe-69f4590324a2 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.285887 May 12 20:40:07.101303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 169/303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:06 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:07.258801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:07.259628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:07.268727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:07.269419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:07.270220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:07.273689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:07.442961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:07.455337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7baf9006-e03a-4705-85fe-9cbdc7660881 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.200724 May 12 20:40:07.456236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 170/304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:07 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:07.604402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:07.605012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:07.618043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:07.618499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:07.619358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:07.619358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:07.889625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:07.908988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:07.911480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:07.923255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fda52259-2466-4a09-9dfe-6e6e3f9fd4b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.317162 May 12 20:40:07.942725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 171/305] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:07 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:08.109374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:08.110708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:08.129851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.132691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.135724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.136436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.366359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:08.374404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08f501cf-411e-4711-8821-f6ab80a6c24c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.270292 May 12 20:40:08.374975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 172/306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:08 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:08.379678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-1c335fe2-3e97-4b9d-be52-3ea78706f643 req-b548b8c4-72dc-4008-9516-2706761a8933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0998ce2c-b880-443e-8e76-98f3fc86f4ff", "name": "network-vif-plugged", "status": "completed", "tag": "932e459a-8011-49ff-85f8-bf61f4d46b2c"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:08.387653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-1c335fe2-3e97-4b9d-be52-3ea78706f643 req-b548b8c4-72dc-4008-9516-2706761a8933 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.388105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-1c335fe2-3e97-4b9d-be52-3ea78706f643 req-b548b8c4-72dc-4008-9516-2706761a8933 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.399436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-1c335fe2-3e97-4b9d-be52-3ea78706f643 req-b548b8c4-72dc-4008-9516-2706761a8933 service nova] Creating event network-vif-plugged:932e459a-8011-49ff-85f8-bf61f4d46b2c for instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff on hv-cinder-81565 May 12 20:40:08.404352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-1c335fe2-3e97-4b9d-be52-3ea78706f643 req-b548b8c4-72dc-4008-9516-2706761a8933 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028284 May 12 20:40:08.406003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 173/307] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:08.480317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:08.481036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:08.488145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.488597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.489400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.489837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.636125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:08.643736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ca06e6f2-07da-4f62-b0df-9c5e8156c49d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.167648 May 12 20:40:08.644305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 174/308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:08 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:08.942728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:08.943806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:08.957987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.962950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:08.964099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:08.964547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:09.138285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:09.148853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:09.150656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:09.151832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c392c7d6-b5ab-449e-a44a-394e13e31d30 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.213925 May 12 20:40:09.163560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 175/309] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:08 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:09.243701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ea3abf0d-a28c-4cc8-a4c9-68e4516f83cf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'create', calling method: .version_select at 0x7f4e6822f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-308251166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQH2SVmsoRSdJRYogUKF4UnuqEJJISBTIoEARMvqQhWt2FBUlYJ2zXmchwu7itTPNjgsT0baFBv2mQLQHFy0ZEM0/HUIUJy3Vx8QqRM+zbgvfsVxr8hGT62VOYuzvdVeA=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:09.260321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-ea3abf0d-a28c-4cc8-a4c9-68e4516f83cf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Getting quotas for project fcbad83733994c35979d60f1bbaf280c. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:40:09.268317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-ea3abf0d-a28c-4cc8-a4c9-68e4516f83cf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Getting quotas for user d6afc66e1d4b473e9a8e6abf1737b64d and project fcbad83733994c35979d60f1bbaf280c. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:40:09.360422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] validate_networks() for [('e8378bf4-b568-4478-81bf-9948fffba758', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:40:09.381872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ea3abf0d-a28c-4cc8-a4c9-68e4516f83cf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.142225 May 12 20:40:09.383163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 176/310] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:40:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:09.396527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:09.397939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:09.409830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:09.410567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:09.411352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:09.411963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:09.634180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:09.646842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-55851a1c-154b-4e04-9e51-9fc66a4ddfb5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.254568 May 12 20:40:09.647907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 177/311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:09 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:09.653866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1661609731", "imageRef": "d080c7e0-5f15-4101-98ad-d7f40a6f14cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-308251166", "networks": [{"uuid": "49fc0e05-6519-4914-8bc4-8efdb885f56a"}]}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:09.719904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] validate_networks() for [('49fc0e05-6519-4914-8bc4-8efdb885f56a', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:40:09.872616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:40:09.873039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:40:09.874095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:40:09.874603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:40:09.874899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:40:09.885047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:09.885837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:09.886844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:09.887347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:09.909740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:40:09.916876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:40:09.932420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:40:09.934820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:40:10.105742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6ad80bb5-ea4c-4d99-900c-7348a60ccaa2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.778941 May 12 20:40:10.106408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 135/312] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:40:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 6780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:40:10.118776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:10.119675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:10.127367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.128127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.129417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.130022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.366859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.379057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-150e330e-7022-49c9-b771-3d308afcf8d0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.264076 May 12 20:40:10.379865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 136/313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:10 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:10.395751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3383adf2-6341-44d4-90f6-dddcef1e90d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:10.396944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3383adf2-6341-44d4-90f6-dddcef1e90d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:10.486079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3383adf2-6341-44d4-90f6-dddcef1e90d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.492942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3383adf2-6341-44d4-90f6-dddcef1e90d1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1239 microversion: 2.1 time: 0.101436 May 12 20:40:10.493555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 137/314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:10 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:10.494907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:40:10.495586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:40:10.496495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:40:10.497927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:40:10.499220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:40:10.504110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:10.504971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:10.511671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.512388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.513496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.514375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.514810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.515264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.519439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.519439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.544178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Getting quotas for project fcbad83733994c35979d60f1bbaf280c. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:40:10.550446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Getting quotas for user d6afc66e1d4b473e9a8e6abf1737b64d and project fcbad83733994c35979d60f1bbaf280c. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:40:10.564797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:40:10.567950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d080c7e0-5f15-4101-98ad-d7f40a6f14cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:40:10.696042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.705560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.707157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.713747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b110d0ff-b764-4b93-9fef-304deb62a8cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.219117 May 12 20:40:10.726448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 138/315] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:10 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:10.726448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:10.726448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:10.728443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.729355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.731221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:10.731998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:10.816963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7f0dc6a6-c869-4439-8556-45918e50152f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167819 May 12 20:40:10.822908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 178/316] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:40:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:40:10.836301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9ebfb74-80ce-4844-9b86-c4b9d7eb1ee6 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:10.836878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f9ebfb74-80ce-4844-9b86-c4b9d7eb1ee6 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:10.950393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f9ebfb74-80ce-4844-9b86-c4b9d7eb1ee6 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:10.961484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f9ebfb74-80ce-4844-9b86-c4b9d7eb1ee6 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1258 microversion: 2.1 time: 0.132900 May 12 20:40:10.968952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 179/317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:10 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1258 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:11.351027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.369833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fa3cd13e-a104-479c-9354-1747f8cfaaaf tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1313 microversion: 2.1 time: 0.652646 May 12 20:40:11.372012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 139/318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:10 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:11.399523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:11.400398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:11.407076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.407525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.408296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.408735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.513441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:11.514515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:11.537717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.538514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.539664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.540164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.665926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.676141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.676284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5f4b4d99-9e01-4efe-b2fb-8d78d06852a8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.278220 May 12 20:40:11.676284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 180/319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:11 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:11.680794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70dc0c3c-4656-436c-869b-147c8a74dda8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1243 microversion: 2.1 time: 0.172357 May 12 20:40:11.691440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 140/320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:11 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1243 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:11.735379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:11.735737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:11.746756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.747213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.748929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:11.749323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:11.943589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.953090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.954528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:11.955706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ab166849-646b-4ae9-893b-b499c0208e87 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.225370 May 12 20:40:11.956517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 181/321] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:11 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:11.976586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f1bb979b-6657-462b-b2f2-b1bcb6ae2ec7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:11.978367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f1bb979b-6657-462b-b2f2-b1bcb6ae2ec7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:12.054376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f1bb979b-6657-462b-b2f2-b1bcb6ae2ec7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:12.061490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f1bb979b-6657-462b-b2f2-b1bcb6ae2ec7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1258 microversion: 2.1 time: 0.089284 May 12 20:40:12.070545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 141/322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:11 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:12.388151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:12.390251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:12.396467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.396927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.397725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.398162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.570590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:12.579808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fba1399c-6b6b-4704-919d-d5e2f2a6905b tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1497 microversion: 2.1 time: 0.195507 May 12 20:40:12.580321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 182/323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:12 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:12.691728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:12.692374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:12.698906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:12.699636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.699781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:12.700089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.700855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.701545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.705860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.706379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.707228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.707739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.771595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:12.779336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b98cd3c9-df3e-4da2-bc34-09dd7d5e8be4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1291 microversion: 2.1 time: 0.084256 May 12 20:40:12.780077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 183/324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:12 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1291 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:12.849296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:12.856784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6b9a04db-42d4-4339-81fc-37820e7ea5c8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.169039 May 12 20:40:12.857455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 142/325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:12 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:12.973805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:12.974430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:12.980495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.980943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:12.981741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:12.982205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.078236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:13.078872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:13.084593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.085035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.086140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.086577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.116854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:13.122663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:13.124946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:13.126236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-decee6d1-2aee-43e2-9701-e078171ca138 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.156494 May 12 20:40:13.126873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 184/326] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:12 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:13.176991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:13.187182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6e46cdb6-d2ec-4d1a-b197-eb0637dac445 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1262 microversion: 2.1 time: 0.112809 May 12 20:40:13.187870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 143/327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:13 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:13.796702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:13.798973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:13.807115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.807573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.808381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.808819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.875427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:13.876045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:13.900690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.910929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.911888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:13.912346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:13.956730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:13.994488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-44569d93-4b95-4f76-a789-9f30e4cb688f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1309 microversion: 2.1 time: 0.201607 May 12 20:40:14.007179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 185/328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:13 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:14.070333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:14.071000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:14.079672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.080175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.084327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.084885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.144055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:40:14.165116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.173962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d9ee597d-a4ae-4d85-9053-b3a9b463eb41 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.303381 May 12 20:40:14.177765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 144/329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:13 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:14.191563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:14.192510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:14.202726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.209579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.210779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.211598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.483056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.496402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.498916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.501197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c880584-8132-4150-b6c0-815092f2023a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.321811 May 12 20:40:14.502312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 145/330] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:14 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:14.509363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:14.511507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:14.519313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.520561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.522180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.522874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.601834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d36115f-78d8-44cd-92d7-8e3dd731fe6a tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 204 len: 0 microversion: 2.1 time: 0.534800 May 12 20:40:14.602741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 186/331] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:40:14 2022] DELETE /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:40:14.612945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:14.613927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:14.624682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.625134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.629480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:14.630087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:14.737838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.752516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8bba8dc7-46c2-4368-a576-0498ffe3b431 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1318 microversion: 2.1 time: 0.248204 May 12 20:40:14.756683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 146/332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:14 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:14.960542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:14.968043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e0d2aece-9896-4294-81f1-7324021e09eb tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1503 microversion: 2.1 time: 0.360122 May 12 20:40:14.968658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 187/333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:14 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:15.014387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:15.015025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:15.021980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.022715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.024533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.025178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.194939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:15.197941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:15.205045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.206384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.207838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.208471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.343785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.354104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-77c020c5-753d-41a3-ba94-81d0ed870c29 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.343703 May 12 20:40:15.356566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 147/334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:15 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:15.474399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.486485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9166615c-b819-4d8c-b212-5efe03422158 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.295537 May 12 20:40:15.499220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 188/335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:15 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:15.521365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:15.522404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:15.532019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.532727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.533736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.534369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.733842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.742289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.744201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.745427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d0bd4af9-8733-467f-b22d-904e8ea653fe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.228527 May 12 20:40:15.755133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 148/336] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:15 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:15.772297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:15.773158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:15.780210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.780690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.781505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:15.781954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:15.882499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:15.890542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4d09ba32-1c85-4696-9e30-d9668f2138e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1318 microversion: 2.1 time: 0.122118 May 12 20:40:15.891137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 189/337] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:15 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:15.992474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:15.993222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:16.019816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.021949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.023085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.024190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.321085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:16.338527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f4b5d9bb-906a-4141-a8fb-8dabdd6ce65d tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1503 microversion: 2.1 time: 0.355934 May 12 20:40:16.341436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 149/338] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:15 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:16.374250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:16.374871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:16.391645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.392095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.392876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.393333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.488656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-9104da31-a2f8-450c-bc3d-7eec9f6f32fe req-adddcfa0-a71e-4545-8c93-52ae27b5f080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "name": "network-vif-plugged", "status": "completed", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:16.507251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9104da31-a2f8-450c-bc3d-7eec9f6f32fe req-adddcfa0-a71e-4545-8c93-52ae27b5f080 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.507698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9104da31-a2f8-450c-bc3d-7eec9f6f32fe req-adddcfa0-a71e-4545-8c93-52ae27b5f080 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.547152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-9104da31-a2f8-450c-bc3d-7eec9f6f32fe req-adddcfa0-a71e-4545-8c93-52ae27b5f080 service nova] Creating event network-vif-plugged:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:40:16.557188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-9104da31-a2f8-450c-bc3d-7eec9f6f32fe req-adddcfa0-a71e-4545-8c93-52ae27b5f080 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072128 May 12 20:40:16.588502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 150/339] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:40:16.634401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:16.635637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:16.672270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.678747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.681524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.684337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.887123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:16.896916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6761df2c-36eb-4023-8572-3bc1f514ee3f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.527478 May 12 20:40:16.898759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 190/340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:16 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:16.919929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:16.925210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:16.934370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.939566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:16.941525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:16.946418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.202751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.211907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4a70dd6-2fae-403a-9490-d3791193dfc8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.608236 May 12 20:40:17.219031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 151/341] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:16 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:17.233586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:17.242517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:17.265694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.266207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.267059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.269649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.284125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.292693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.294448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.296127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f301b37a-9e34-46fc-b58d-88a719549417 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.386154 May 12 20:40:17.307760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 191/342] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:16 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:17.360281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:17.360828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:17.367074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.367536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.368328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.368768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.398006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.406012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7d838368-77ed-4cbd-8406-cd5d5a3919f8 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1316 microversion: 2.1 time: 0.185636 May 12 20:40:17.407844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 152/343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:17 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:17.520940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:17.528236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08ec0495-d6a3-4827-bb35-662cc93b8524 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1503 microversion: 2.1 time: 0.172096 May 12 20:40:17.528799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 192/344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:17 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:17.766216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-eaedd5ac-9aa9-48ec-be55-94d083825a27 req-6cafe953-57f8-42f8-bce6-6a8eea79cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0998ce2c-b880-443e-8e76-98f3fc86f4ff", "name": "network-vif-deleted", "tag": "932e459a-8011-49ff-85f8-bf61f4d46b2c"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:17.784229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-eaedd5ac-9aa9-48ec-be55-94d083825a27 req-6cafe953-57f8-42f8-bce6-6a8eea79cd93 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.811906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-eaedd5ac-9aa9-48ec-be55-94d083825a27 req-6cafe953-57f8-42f8-bce6-6a8eea79cd93 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.811906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-eaedd5ac-9aa9-48ec-be55-94d083825a27 req-6cafe953-57f8-42f8-bce6-6a8eea79cd93 service nova] Creating event network-vif-deleted:932e459a-8011-49ff-85f8-bf61f4d46b2c for instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff on hv-cinder-81565 May 12 20:40:17.811906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-eaedd5ac-9aa9-48ec-be55-94d083825a27 req-6cafe953-57f8-42f8-bce6-6a8eea79cd93 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041992 May 12 20:40:17.811906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 153/345] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:17.917048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:17.917983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:17.926037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.926612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:17.927581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:17.928139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.078607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.089206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-468d0480-1de3-4087-8bf5-f5191c8a06ae tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.176658 May 12 20:40:18.089800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 193/346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:17 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:18.237639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:18.238481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:18.251743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.251743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.251743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.251743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.316761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:18.317477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:18.334273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.335321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.335828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.338141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.630934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.651069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1a760cb8-8032-4ed6-b47a-74b94336a80c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.418779 May 12 20:40:18.652294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 154/347] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:18 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:18.652427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.667871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.671375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-e235e004-9319-46e9-a793-d4e9143205c9 req-21d232e5-465d-4f13-869f-1629a31435ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0592bc35-ec6e-4ccb-b2e5-39184df8c10d", "tag": "a0106765-c4b4-4cc4-b53a-c2dd3a5e223b"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:18.673086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.675150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-002c9d4a-d177-41c6-ba48-7e23855e8eed tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.364411 May 12 20:40:18.687461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 194/348] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:18 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:18.689076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-e235e004-9319-46e9-a793-d4e9143205c9 req-21d232e5-465d-4f13-869f-1629a31435ba service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.689953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-e235e004-9319-46e9-a793-d4e9143205c9 req-21d232e5-465d-4f13-869f-1629a31435ba service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.706303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:18.706303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:18.725467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-e235e004-9319-46e9-a793-d4e9143205c9 req-21d232e5-465d-4f13-869f-1629a31435ba service nova] Creating event network-changed:a0106765-c4b4-4cc4-b53a-c2dd3a5e223b for instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d on hv-cinder-81565 May 12 20:40:18.725712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.726181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.729942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.730500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.733481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-e235e004-9319-46e9-a793-d4e9143205c9 req-21d232e5-465d-4f13-869f-1629a31435ba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077966 May 12 20:40:18.734267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 155/349] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:18.741472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:18.742177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:18.748503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.748890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.749716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.750859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.851370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:18.851806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:18.852272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:18.936667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.945903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-753b426d-05a4-47fb-a491-dfeb88f1333c tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.208160 May 12 20:40:18.946281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 156/350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:18 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:18.977173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:18.985191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2dab5c3b-a1da-4a15-911b-257510d6f561 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.296519 May 12 20:40:18.986690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 195/351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:18 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:19.110797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:19.110797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:19.120417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.122325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.126506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.126872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.313515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:19.330021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-66e32554-f531-4889-b207-d7d6b94a5a7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.227185 May 12 20:40:19.330600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 157/352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:19 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:19.669148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:19.670085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:19.676166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.676616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.677471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.677919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.704478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:19.705218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:19.712542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.713000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.713819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.714259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:19.816395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:19.824662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e81e9ed3-5fc4-4f45-85d1-b24ea45e86ff tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.159392 May 12 20:40:19.825238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 196/353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:19 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:19.870620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:19.880222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:19.881749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:19.882911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a8f95d18-6999-41ef-b144-659ae575f3b2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.182968 May 12 20:40:19.883647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 158/354] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:19 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:19.971672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:19.976123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:19.995118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:19.997342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.005493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:20.007072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:20.009812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.014400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.014955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.015064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.015742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.016211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.065827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.066289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.066751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:20.139935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:20.147302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7083c0b6-a60a-42ea-ae18-461b83281955 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.187085 May 12 20:40:20.147866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 197/355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:19 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:20.204612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:20.214408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1a7fc693-8783-4373-8200-8c136068172b tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.215284 May 12 20:40:20.215175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 159/356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:19 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:20.347909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:20.348620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:20.354834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.355359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.356133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.356568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.487308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:20.495640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a2f85f5-80d3-4a8d-8105-511e2f4545cb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.151736 May 12 20:40:20.506277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 198/357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:20 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:20.842170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:20.843092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:20.854726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.855196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.855993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.856444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.902223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:20.904830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:20.911434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.912517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:20.913464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:20.913988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.016367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.024281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-41afe11f-e4ac-4687-a474-e0f924daa3b6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.185922 May 12 20:40:21.025004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 160/358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:20 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:21.070603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.079830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.081350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.082850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-76a97e47-f801-4d60-92a5-ecd3cc9537db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.184915 May 12 20:40:21.083411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 199/359] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:20 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:21.163941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:21.164687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:21.170801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.171251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.172018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.172451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.203568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.204020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.204698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:21.231823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:21.232460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:21.239720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.240164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.240936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.241402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.246400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.256914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cff5d9e7-25d6-4db3-bf28-3ef7b0429ffd tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.096701 May 12 20:40:21.257984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 161/360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:21 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:21.400116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.407695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b9c43a77-081b-40f4-bcc1-e2b03d6e4e75 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.179674 May 12 20:40:21.408276 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 200/361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:21 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:21.513614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:21.514237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:21.520404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.520860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.521844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:21.522289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:21.660892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:21.678545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-caf0332e-baf8-4497-b6ee-16d1df9a3d33 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.168456 May 12 20:40:21.683242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 162/362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:21 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:22.041923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:22.042750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:22.050020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.050464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.051234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.051666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.102494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:22.103187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:22.123905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.124267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.125226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.125656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.206794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.214457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-912b8d16-ca9c-4251-b91b-58613958da2a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.176348 May 12 20:40:22.215424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 201/363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:22 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:22.274557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:22.275170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:22.281421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.282167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.282619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.283387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.283847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.289379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.290856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.292007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-faf602e7-3b37-4415-bb27-4643dd818baa tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.193353 May 12 20:40:22.292557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 163/364] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:22 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:22.314655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.315101 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.315822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:22.358393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.365590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7758bc05-42c8-4fa7-9db5-fd2273f33b75 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.094924 May 12 20:40:22.366174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 202/365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:22 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:22.424763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:22.425362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:22.435066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.439244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.439244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.439244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.597402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.605992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-68b40bce-d2c9-4b7d-a245-94e70341dabf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.184951 May 12 20:40:22.606644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 164/366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:22 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:22.696911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:22.697470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:22.709114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.709114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.709114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:22.709114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:22.840601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:22.849563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1e0151a8-c9b1-486a-b708-52d5584a8dd7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.157063 May 12 20:40:22.850210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 203/367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:22 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:23.230899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:23.231516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:23.238383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.238828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.239586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.240016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.312526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:23.313115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:23.319488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.319959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.320675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.321110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.383078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.394150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4d00f28c-31b6-4fca-8514-83255ca1f528 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.166731 May 12 20:40:23.395183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 165/368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:23 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:23.407258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:23.408024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:23.416370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.416773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.417603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.418053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.469169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.469678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.470344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:23.484762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.493260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.494809 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.495978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1d5bb7ee-3d23-4a77-89c3-97657a66969e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.188875 May 12 20:40:23.496730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 204/369] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:23 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:23.513583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.522187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-30e479d9-af2d-4e5f-a554-ee66b868a6aa tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.125828 May 12 20:40:23.522963 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 166/370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:23 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:23.626105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:23.626740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:23.633364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.633811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.634571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.635000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.767050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:23.774397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eb699422-87f3-4a32-add7-f41479b1d42a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.153059 May 12 20:40:23.774948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 205/371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:23 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:23.867594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:23.868215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:23.875130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.875655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:23.876582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:23.877022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.019273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.028128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ef6fddef-070d-4233-9b31-4f07089d87c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.164422 May 12 20:40:24.028712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 167/372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:23 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:24.416347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:24.417108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:24.424863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.425381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.426240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.426736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.515659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:24.522398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:24.524404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.524876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.525715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.526164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.571612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.579468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c533b653-ae7a-4f81-8f2f-eacbcf5de26e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.167280 May 12 20:40:24.580048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 206/373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:24 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:24.584769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:24.585415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:24.591213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.591709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.592527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.592965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.626232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.626677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.627119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:24.666497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.670111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.674403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a22a7376-c6a6-477c-a900-a17026a73394 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.093369 May 12 20:40:24.674979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 207/374] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:24 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:24.678283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.679801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.680953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5897eeb7-b749-4f2f-9c46-85aa364bc5d2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.169373 May 12 20:40:24.681527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 168/375] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:24 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:24.790796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:24.791400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:24.798389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.798842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.799604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:24.800037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:24.957913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:24.975893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5149b758-866b-429c-8398-c387ecb20eb1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.188753 May 12 20:40:24.976575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 208/376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:24 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:25.046555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:25.047164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:25.053494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.053938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.054702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.055133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.183699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.191145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-00b41456-d5c3-4374-93ff-1eb933e1a94f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.149256 May 12 20:40:25.191704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 169/377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:25 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:25.596454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:25.597070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:25.603590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.604046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.604814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.605256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.691487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:25.692140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:25.699111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.699561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.700332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.700776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.732496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.732945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.733426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:25.733618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.740822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-66cca4ca-1668-474d-8f12-ec5ee157ec46 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.148805 May 12 20:40:25.741412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 209/378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:25 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:25.745871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:25.749763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:25.753267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.753993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.754794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:25.755231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:25.776629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.784186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-66738f6c-a238-4dc6-8dff-2f623ff8fe30 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.096600 May 12 20:40:25.790003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 170/379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:25 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:25.905837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.914426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.915967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:25.917090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1cd4d932-5988-4afa-964c-f7f1e00822e5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.174762 May 12 20:40:25.928917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 210/380] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:25 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:25.994512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:25.995147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:26.001704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.002157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.002921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.003363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.129424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:26.136749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3ea3abf8-1550-461b-a1bf-8d83cbf96566 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.146109 May 12 20:40:26.137321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 171/381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:25 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:26.208227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:26.208935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:26.215757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.216264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.217077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.217579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.365047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:26.372480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8fff64d5-20b1-4aac-8c3f-1b2dfd297f6a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.168401 May 12 20:40:26.373896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 211/382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:26 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:26.759097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:26.759097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:26.767602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.768057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.768905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.769362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.800697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:26.801381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:26.807654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.808094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.808852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.809300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.841173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.841646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.842086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:26.883474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:26.891368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-55a61d02-a022-4fe9-92e3-27bedac2c1e9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.094517 May 12 20:40:26.891947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 212/383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:26 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:26.899552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:26.906793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d31345d8-f12d-404f-bacb-c6741c948137 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.151547 May 12 20:40:26.907348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 172/384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:26 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:26.935601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:26.936871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:26.942743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.943192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:26.943947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:26.944382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.074830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:27.090101 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:27.093287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:27.095188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6cb693a2-2b4b-4044-a313-49337d15fc2c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.163383 May 12 20:40:27.096191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 213/385] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:26 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:27.153527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:27.154610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:27.161751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.162298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.163162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.163662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.298225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:27.309324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2b1985ca-b211-4046-9d6e-8765bbbfe30d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.158299 May 12 20:40:27.309324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 173/386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:27 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:27.390971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:27.391584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:27.397575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.398028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.398795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.399233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.539112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:27.546895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4957c565-9311-45af-a8a8-881877eeb1d8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.160349 May 12 20:40:27.547477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 214/387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:27 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:27.908508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:27.909118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:27.915469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.915918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.916683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.917158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.924068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:27.924707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:27.930648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.931100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.931866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.932304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.950802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:27.951254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:27.952357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:28.011526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.021235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-afd96299-7fc3-4426-8d0b-bcec02f46799 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.116959 May 12 20:40:28.022012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 174/388] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:27 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:28.093250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.101579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1f2999ab-f80c-4ac7-830b-cd38f4838cfa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.181977 May 12 20:40:28.102459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 215/389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:27 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:28.113671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:28.114281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:28.120294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.120681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.121500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.121936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.248236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.256914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.258454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.259600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5b5c0037-21d1-49f8-85b0-a4ea7edb75ff tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.149829 May 12 20:40:28.260151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 175/390] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:28 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:28.324970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:28.325625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:28.331510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.331961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.332724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.333162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.476229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.484757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4d9bbf5b-719b-49c9-9b02-4993f54399de tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.163485 May 12 20:40:28.485547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 216/391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:28 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:28.565651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:28.566292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:28.572369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.572821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.573619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:28.574059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:28.744302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:28.752204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e274289e-c079-4e30-b25f-4548efc73dcb tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.191045 May 12 20:40:28.752771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 176/392] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:28 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:29.045482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:29.045482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:29.046194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.046194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.046865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.047297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.081169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.081636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.082086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:29.119277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:29.119877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:29.126462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.127059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.127520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.128917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.129521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.134331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-98371418-e47a-4d30-afc9-9524997ee961 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.100067 May 12 20:40:29.135256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 217/393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:29 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:29.270203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.278044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:29.279139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bc74950a-3106-41a5-b319-77918d0e64f4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.164679 May 12 20:40:29.279563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:29.280132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 177/394] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:29 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:29.291968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.292716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.293642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.294612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.440424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.446303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.447892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.448998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f6277f03-f06d-43a6-82ef-e851116a6bba tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.175195 May 12 20:40:29.449590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 218/395] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:29 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:29.502214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:29.503434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:29.510066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.510697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.511479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.511919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.662719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.670046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ec679277-45d5-480e-83a5-6674069cf44f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.172266 May 12 20:40:29.671244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 178/396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:29 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:29.771421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:29.772363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:29.779065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.779523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.780444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:29.780886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:29.908749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:29.915994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-53c43816-c146-4e8a-9c65-f31c80a0b197 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.149850 May 12 20:40:29.916549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 219/397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:29 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:30.152581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:30.153151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:30.159753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.160205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.160977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.161514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.193154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.193640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.194089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:30.237298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.244551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-daf302c8-86c3-484f-9594-6590ebaa9bc9 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.095908 May 12 20:40:30.245105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 179/398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:30 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:30.296182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:30.296780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:30.303079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.303522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.304275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.304708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.433484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.441370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-398bc115-6516-4c41-9c02-57b7c03b8cde tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.149426 May 12 20:40:30.448551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 220/399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:30 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:30.468258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:30.468872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:30.476453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.476912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.477730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.478200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.608315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.616006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.617540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.618693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e6dd93b6-41dc-4697-a3a9-e06a92635c38 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.154582 May 12 20:40:30.619249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 180/400] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:30 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:30.687874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:30.688445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:30.694396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.694851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.695612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.696057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.818836 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:30.826027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ff69a3da-03bd-4c8b-97a6-79a3e01dbbbd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.142652 May 12 20:40:30.826867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 221/401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:30 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:30.933326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:30.933945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:30.940121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.940516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:30.941303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:30.941766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.066666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.073857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ed89ca4f-9770-41fb-849d-08790c83c8d4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.144453 May 12 20:40:31.074420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 181/402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:30 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:31.261892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:31.262415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:31.268684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.269125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.269947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.270381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.301326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.301857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.302193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:31.341022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.348634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8e03c46b-319e-4e38-aefd-6dcead2f70c5 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.090668 May 12 20:40:31.349189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 222/403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:31 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:31.463946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:31.464556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:31.471077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.471526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.472295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.472765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.637589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:31.638231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:31.644433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.644891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.645694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.646134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.659185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.671400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6e59a3a2-edca-4fb0-a2de-8d07a0ac46aa tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1369 microversion: 2.1 time: 0.210530 May 12 20:40:31.672774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 182/404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:31 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:31.800648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.809011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.810480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:31.811690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0c267a2c-fbd8-406f-b40e-f1e2e00f072a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1740 microversion: 2.20 time: 0.178156 May 12 20:40:31.812437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 223/405] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:31 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:31.843921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:31.844548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:31.851396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.854030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:31.854030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:31.854030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.080191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:32.087576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fb77d653-37c2-4ab6-b23e-8b7b8069c195 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.248286 May 12 20:40:32.088295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 183/406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:31 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:32.091532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:32.093038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:32.099081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.099610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.100427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.100929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.247922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:32.256170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-35b84395-5967-4df4-8d2d-361138c705e4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.168845 May 12 20:40:32.256739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 224/407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:32 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:32.367223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:32.367867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:32.374459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.374884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.375727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.376623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.409770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.410220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.410681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lazy-loading 'fault' on Instance uuid 0998ce2c-b880-443e-8e76-98f3fc86f4ff {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:40:32.478562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a1cc28fbe48b18d0fd19415cd7a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43069e4b5d394dc4a733cf11628eac72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:32.487416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-50d647aa-a505-4e33-9f85-c20884a5b219 tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 200 len: 1303 microversion: 2.1 time: 0.125249 May 12 20:40:32.496937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 184/408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:32 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:32.688533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:32.689744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:32.696556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.697399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.698430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.699484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.832734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:32.833484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:32.841374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.841894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.844404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.845164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.937521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:32.944934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-59acedf0-0860-446b-8308-7a657b2c4012 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1563 microversion: 2.1 time: 0.260303 May 12 20:40:32.956467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 225/409] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:32 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:32.965113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:32.983464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:32.983464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.983464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:32.983464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:32.984358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.148401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-82b795c2-9059-4dba-a3a4-4cc4867c757c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189748 May 12 20:40:33.149153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 226/410] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:40:32 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:40:33.154411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:33.155642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:33.169844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.170071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.171577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.172310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.225572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:33.241936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:33.244478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:33.246690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e6d0bc95-06fe-4df2-8ecb-8ef13cd79107 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1722 microversion: 2.20 time: 0.419266 May 12 20:40:33.259121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 185/411] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:32 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:33.267104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-daae538e-9a96-4ff3-8590-6041b2c59156 req-2b31b1ad-58e0-4354-b56f-704ffff51753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:33.275374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-daae538e-9a96-4ff3-8590-6041b2c59156 req-2b31b1ad-58e0-4354-b56f-704ffff51753 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.275822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-daae538e-9a96-4ff3-8590-6041b2c59156 req-2b31b1ad-58e0-4354-b56f-704ffff51753 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.290460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-daae538e-9a96-4ff3-8590-6041b2c59156 req-2b31b1ad-58e0-4354-b56f-704ffff51753 service nova] Creating event network-changed:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:40:33.301793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-daae538e-9a96-4ff3-8590-6041b2c59156 req-2b31b1ad-58e0-4354-b56f-704ffff51753 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044962 May 12 20:40:33.302733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 186/412] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:33.307832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:33.308612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:33.316164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.316623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.317440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.318105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.469961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:33.478275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ce22b047-699f-47b0-bfa6-74acc1e1e206 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.174318 May 12 20:40:33.478871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 187/413] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:33 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:33.510674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:33.510674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] [instance: 0998ce2c-b880-443e-8e76-98f3fc86f4ff] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:33.513111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.513589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.515034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.515463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.530630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] HTTP exception thrown: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Request method failure captured: May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff HTTP/1.1 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB2wqGkucCf9GQI4j7mFx3G14rxG8k-JJRNElGR5cNL_iI4ARZybH4qMBZuFVUFiS_magQNSN_7SunxmicO36S2hgJFKUAqSilnet6yVDzusjR5aBFcZFVGrGVWaspU2GZR0QYkX7svU_Ugj279ZDP-W6iyVRt7eOBoGMWIj-7fnL0 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 43069e4b5d394dc4a733cf11628eac72 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesActionsTest-1182233973 May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:40:33.532359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_43069e4b5d394dc4a733cf11628eac72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/43069e4b5d394dc4a733cf11628eac72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesActionsTest-1182233973 May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 43069e4b5d394dc4a733cf11628eac72 May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesActionsTest-1182233973 May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesActionsTest-1182233973-project May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: eb3a1cc28fbe48b18d0fd19415cd7a53 May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesActionsTest-1182233973-project May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. May 12 20:40:33.534133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0998ce2c-b880-443e-8e76-98f3fc86f4ff'} May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:40:33.538238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. May 12 20:40:33.539682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:40:33.541003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] Returning 404 to user: Instance 0998ce2c-b880-443e-8e76-98f3fc86f4ff could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:40:33.541003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-19e2c22f-5d11-49f3-8690-7984d8619ace tempest-VolumesActionsTest-1182233973 tempest-VolumesActionsTest-1182233973-project] 10.222.0.59 "GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff" status: 404 len: 111 microversion: 2.1 time: 0.033008 May 12 20:40:33.541003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 188/414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:33 2022] GET /compute/v2.1/servers/0998ce2c-b880-443e-8e76-98f3fc86f4ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 20:40:33.637685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:33.645875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-026d51db-304f-4e41-ab1b-6176980c235f tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.495240 May 12 20:40:33.646748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 227/415] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:33 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:33.781132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:33.781786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:33.787806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.788328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.789168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:33.789710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:33.813795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a1533b57-7318-482a-8b55-3196bcb7351f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/ips" status: 200 len: 146 microversion: 2.1 time: 0.036788 May 12 20:40:33.814463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 189/416] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:40:33 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:34.266502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:34.267815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:34.274464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.275113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.275984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.276348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.497073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:34.497383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:34.497383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:34.505394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.505965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.506479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:34.506739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.507172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.508208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:34.509451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-97a2f505-1210-44e7-a480-0e0c6f08331f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1722 microversion: 2.20 time: 0.247084 May 12 20:40:34.520159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 228/417] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:34 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:34.665803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:34.666640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:34.669204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:34.673784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.674525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.675527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.676191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.677539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e89464e3-1358-4698-8036-f0e8863b5f4e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.185200 May 12 20:40:34.678101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 190/418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:34 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:34.687894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-55864820-072b-4dbf-be51-d4ad93aa4bfa req-5caf92bb-2f3f-4356-bfb6-4f8733738a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:34.691630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-55864820-072b-4dbf-be51-d4ad93aa4bfa req-5caf92bb-2f3f-4356-bfb6-4f8733738a57 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:34.699962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-55864820-072b-4dbf-be51-d4ad93aa4bfa req-5caf92bb-2f3f-4356-bfb6-4f8733738a57 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:34.704229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-55864820-072b-4dbf-be51-d4ad93aa4bfa req-5caf92bb-2f3f-4356-bfb6-4f8733738a57 service nova] Creating event network-changed:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:40:34.709244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-55864820-072b-4dbf-be51-d4ad93aa4bfa req-5caf92bb-2f3f-4356-bfb6-4f8733738a57 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030054 May 12 20:40:34.710168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 191/419] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:34.884491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:34.891999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-88102029-56bf-43dc-ac37-66ff92c90af1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.230048 May 12 20:40:34.892640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 229/420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:34 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:35.528770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:35.530175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:35.536807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.537264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:35.538099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.538546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:35.680773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:35.693719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:35.695512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:35.696892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:35.697015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:35.698283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-14797e98-b45f-45e2-a615-4010c301940f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1722 microversion: 2.20 time: 0.174264 May 12 20:40:35.698986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 192/421] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:35 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:35.706837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.707941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:35.708889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.711490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:35.858957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:35.867806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d6d408f1-e493-4fc8-b20f-e812ac5c4b26 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.176451 May 12 20:40:35.868531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 230/422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:35 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:35.909404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:35.910024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:35.915869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.916318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:35.917075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:35.917541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:36.050049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:36.057680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-16625b22-386a-4802-9f90-c0b3bc8d2f85 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.152852 May 12 20:40:36.058526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 193/423] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:35 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:36.141680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-e3eee3c5-af98-4eca-97bd-dc665866daf0 req-fc50552c-4c3a-4606-acfd-f83c3b7107cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "name": "network-vif-unplugged", "status": "completed", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:36.149779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e3eee3c5-af98-4eca-97bd-dc665866daf0 req-fc50552c-4c3a-4606-acfd-f83c3b7107cf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:36.150228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e3eee3c5-af98-4eca-97bd-dc665866daf0 req-fc50552c-4c3a-4606-acfd-f83c3b7107cf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:36.160804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-e3eee3c5-af98-4eca-97bd-dc665866daf0 req-fc50552c-4c3a-4606-acfd-f83c3b7107cf service nova] Creating event network-vif-unplugged:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:40:36.165774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-e3eee3c5-af98-4eca-97bd-dc665866daf0 req-fc50552c-4c3a-4606-acfd-f83c3b7107cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028531 May 12 20:40:36.167600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 231/424] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:36.718497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:36.719107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:36.725431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:36.725881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:36.726650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:36.727086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:36.857141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:36.865985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:36.867422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:36.868568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ab9344f-9665-46b5-8649-52a48853bebf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1722 microversion: 2.20 time: 0.154007 May 12 20:40:36.869109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 194/425] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:36 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:36.886344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:36.887024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:36.893430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:36.893819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:36.894575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:36.895003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:37.022775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:37.030560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cf554656-d057-4764-9542-f238ebc6dc2e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.149013 May 12 20:40:37.031123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 232/426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:36 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:37.074932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:37.075538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:37.082031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:37.082485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:37.083252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:37.083690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:37.217828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:37.225074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-74099827-e190-4f9e-9f6f-60f6c39add08 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.153935 May 12 20:40:37.225674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 195/427] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:37 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:37.887378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:37.887980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:37.894859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:37.895309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:37.896060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:37.896487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.023447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:38.032538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:38.034072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:38.035217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d7f24af-5d73-4e7f-906a-c48410797a79 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1722 microversion: 2.20 time: 0.151730 May 12 20:40:38.035760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 233/428] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:37 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:38.046782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:38.047403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:38.053695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.054149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.054921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.055361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.182708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:38.189978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-875db16c-e7c3-4810-b267-3bb0774505ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.147119 May 12 20:40:38.190546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 196/429] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:38 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:38.242467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:38.242467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:38.248162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.248613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.249415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.249849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.447076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:38.455838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5a6760f8-8dd9-4280-ab3b-036ee0a7a991 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.218192 May 12 20:40:38.456644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 234/430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:38 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:38.809194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41650904-f7f2-4754-9a18-1a0f4fcd2f16"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:38.813764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:38.822835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.823284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:38.824597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:38.824597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.052616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:39.053215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:39.059428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.059873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.061455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.061961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.208638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:39.218401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:39.220300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:39.221755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-70955ff5-d908-459e-90f2-c4fe40ba2079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1725 microversion: 2.20 time: 0.172855 May 12 20:40:39.222239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 235/431] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:39 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:39.227052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:39.227653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:39.234576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.235227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.236198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.236772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.374792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:39.383671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1ef2382-5d1a-4666-a032-8158389bd27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.160269 May 12 20:40:39.384232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 236/432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:39 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:39.390131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc53161f-d703-4d08-b344-593dd400e8d8"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:39.391499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:39.398256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.399043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:39.400011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:39.400444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.208433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-446b612f-0cfa-4a4e-9356-f53c70f7d8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.407458 May 12 20:40:41.214738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 197/433] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:40:38 2022] POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments => generated 194 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:40:41.222666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:41.223713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:41.232813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.234430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.234923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-aa53d701-7212-4583-a22e-e55de5809685 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.848781 May 12 20:40:41.235624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.235861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.239411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 237/434] 10.222.0.59 () {62 vars in 1363 bytes} [Thu May 12 20:40:39 2022] POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments => generated 188 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:40:41.252943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:41.254145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:41.268721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.282578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.282578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.282578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.467335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:41.474106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:41.478500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-93340807-5a62-4c62-8ccb-e11ba8de2e25 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.262142 May 12 20:40:41.484900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 198/435] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:41 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:41.485142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5385b02d-8789-4c88-ae63-686844623249 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.244033 May 12 20:40:41.485781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 238/436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:41 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:41.497436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:41.498244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:41.507866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.508424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.509290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.509827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.914465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-764c9cfd-a3cc-4a29-a680-e8780a954a70 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/action" status: 202 len: 0 microversion: 2.20 time: 0.430757 May 12 20:40:41.915898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 199/437] 10.222.0.59 () {62 vars in 1318 bytes} [Thu May 12 20:40:41 2022] POST /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 20:40:41.937778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:41.940186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:41.950965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.956567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:41.956567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:41.956567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:42.118918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:42.135206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:42.136721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:42.137939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-77c4bccb-f0b5-41e5-9ba9-0f3160f3e889 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1751 microversion: 2.20 time: 0.213084 May 12 20:40:42.145563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 239/438] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:41 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:42.500059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:42.507319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:42.507462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:42.507462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:42.507974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:42.508443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:42.509229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:42.509694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:42.514927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:42.515654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:42.516661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:42.517349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:42.689250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:42.702832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:42.703450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f1667c7a-6976-4abf-8a13-62b2a1574976 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.204955 May 12 20:40:42.704343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 240/439] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:42 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:42.711844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b5bd90df-d30d-496e-b0f5-7b16149bc163 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.216426 May 12 20:40:42.714833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 200/440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:42 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:43.175442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:43.175979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:43.189356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.189814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.190597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.191037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.353956 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-2bddee55-2357-4723-8545-a65d03436c84 req-6a3c1ad9-7ea9-45db-b2b7-971922e6dfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "name": "network-vif-plugged", "status": "completed", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:43.371224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2bddee55-2357-4723-8545-a65d03436c84 req-6a3c1ad9-7ea9-45db-b2b7-971922e6dfff service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.371789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2bddee55-2357-4723-8545-a65d03436c84 req-6a3c1ad9-7ea9-45db-b2b7-971922e6dfff service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.377807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:43.384528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-2bddee55-2357-4723-8545-a65d03436c84 req-6a3c1ad9-7ea9-45db-b2b7-971922e6dfff service nova] Creating event network-vif-plugged:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:40:43.387792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:43.390368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:43.390781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-2bddee55-2357-4723-8545-a65d03436c84 req-6a3c1ad9-7ea9-45db-b2b7-971922e6dfff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040514 May 12 20:40:43.391473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 201/441] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:43.391608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e1890445-fe34-4c8c-834e-4e8d63d0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1751 microversion: 2.20 time: 0.225138 May 12 20:40:43.395496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 241/442] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:43 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:43.731446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:43.733884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:43.735840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:43.735968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:43.743853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.746469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.748846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.749600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.750665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.751295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.752606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:43.753545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:43.985072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:43.994216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-63383ecd-71b2-4452-acc7-d0cdb712eadf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.264392 May 12 20:40:43.996380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 242/443] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:43 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:44.070169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:44.078827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c476095a-fee9-4973-98cf-04f7e2065ff3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.360540 May 12 20:40:44.080423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 202/444] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:43 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:44.415299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:44.416185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:44.426460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:44.427879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:44.429023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:44.429721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:44.602298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:44.612141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:44.614033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:44.615407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5bdc54f2-b51a-4611-b95c-f8ee79674513 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.203997 May 12 20:40:44.626728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 243/445] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:44 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:45.014972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:45.016294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:45.026264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.027028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.028345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.029608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.098547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:45.099211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:45.106895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.107423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.108348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.108792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.187278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:45.195933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1018a8bc-f203-421f-ac5b-bdd3e86d1f8a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1358 microversion: 2.1 time: 0.186791 May 12 20:40:45.196138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 203/446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:45 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:45.277026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:45.285375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7d486a69-c439-443d-9dfe-61d224c6f27a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.190896 May 12 20:40:45.286181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 244/447] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:45 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:40:45.406501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-6a52606d-8448-4c9a-8bff-28f7ff463da2 req-2143819c-86a2-4193-9930-f980af93ea57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0592bc35-ec6e-4ccb-b2e5-39184df8c10d", "name": "network-vif-plugged", "status": "completed", "tag": "a0106765-c4b4-4cc4-b53a-c2dd3a5e223b"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:45.414728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-6a52606d-8448-4c9a-8bff-28f7ff463da2 req-2143819c-86a2-4193-9930-f980af93ea57 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.415177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-6a52606d-8448-4c9a-8bff-28f7ff463da2 req-2143819c-86a2-4193-9930-f980af93ea57 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.426415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-6a52606d-8448-4c9a-8bff-28f7ff463da2 req-2143819c-86a2-4193-9930-f980af93ea57 service nova] Creating event network-vif-plugged:a0106765-c4b4-4cc4-b53a-c2dd3a5e223b for instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d on hv-cinder-81565 May 12 20:40:45.444655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-6a52606d-8448-4c9a-8bff-28f7ff463da2 req-2143819c-86a2-4193-9930-f980af93ea57 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042088 May 12 20:40:45.445285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 204/448] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:45.640887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:45.641555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:45.658341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.659051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.660768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:45.661480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:45.841046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:45.851507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:45.853241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:45.854531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d084161-df10-4aae-bba9-eedc9a8194cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.223605 May 12 20:40:45.870454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 245/449] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:45 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:46.213705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.214942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:46.223044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.223775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.224762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.225418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.303992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.304642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:46.313013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.313524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.314282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.314721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.392314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:46.401772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-964baf97-b540-4367-8f23-1794dfab384e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1547 microversion: 2.1 time: 0.193360 May 12 20:40:46.414795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 205/450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:46.420820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.421809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:46.428517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.429267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.430928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.431568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.469889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:46.479810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-474abbec-b6d8-4547-ada9-dcecb399e443 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.178427 May 12 20:40:46.489325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 246/451] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:46.588155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:46.595775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ad9bf394-f41d-4e04-835c-a642aa180ca1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1547 microversion: 2.1 time: 0.179576 May 12 20:40:46.596653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 206/452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:46.612861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.616463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:46.617448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Searching by: {'deleted': False, 'project_id': 'fcbad83733994c35979d60f1bbaf280c'} {{(pid=129358) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 20:40:46.624997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.625580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.626524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.639214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.755381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.multi_cell_list [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129358) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 20:40:46.851935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e41208ee-4152-4f98-b078-aed8e3eb887d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.243079 May 12 20:40:46.853416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 247/453] 10.222.0.59 () {58 vars in 1124 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:46.863032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.863643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:46.870725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.871185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.871951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.872390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.873904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:46.874813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:46.881778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.882322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:46.883145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:46.883602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:47.028917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:47.037810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8ffd13fe-8bce-4e31-8fe2-2f449dd013db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1547 microversion: 2.1 time: 0.178412 May 12 20:40:47.039639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 207/454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:47.058901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:47.067576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:47.069085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:47.070282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-695b3737-1434-4b30-ae3a-ea8679347832 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.201383 May 12 20:40:47.071098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 248/455] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:46 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:47.496259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:47.497015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:47.505313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:47.506174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:47.507278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:47.508005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:47.675682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:47.686940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c014f329-6895-4576-8a2b-5270ff819be3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1364 microversion: 2.1 time: 0.194902 May 12 20:40:47.696240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 208/456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:47 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:48.089005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:48.089750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:48.098255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.104143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:48.104143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.104143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:48.260829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:48.271374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:48.272924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:48.275664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-24ac06a6-b4c9-46e3-8197-72424602a740 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.191412 May 12 20:40:48.276461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 249/457] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:48 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:48.706566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:48.707209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:48.725076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.725693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:48.726567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.727085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:48.879603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:48.888262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6f67ba13-6433-4634-b8d6-acd7a03cee75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1554 microversion: 2.1 time: 0.187093 May 12 20:40:48.889427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 209/458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:48 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:48.905396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:48.905892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:48.915549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.916487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:48.926710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:48.927739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:49.045040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-546e2b4c-462b-478b-a867-0c7233a58a5f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143817 May 12 20:40:49.051532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 250/459] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:40:48 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:49.184975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35dadfb8-6ef5-42be-9afd-4cf2d0ddd610"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:49.186583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:49.194694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:49.195285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:49.196937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:49.196937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:49.296886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:49.297489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:49.306297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:49.319323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:49.321728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:49.322363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:49.567251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:49.576720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:49.579601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:49.581213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-05f487f4-0e88-47ae-a7b7-5a66023c9d4b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.289186 May 12 20:40:49.592595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 251/460] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:49 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:50.157336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8de1da7b-f0f0-4b3d-9f57-890c9ae5e62c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:50.163633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8de1da7b-f0f0-4b3d-9f57-890c9ae5e62c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:50.164091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8de1da7b-f0f0-4b3d-9f57-890c9ae5e62c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:50.215164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-44139d4d-fd8a-446a-a14f-cc46924bfdad tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039583 May 12 20:40:50.221904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 210/461] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:40:49 2022] POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:50.227821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8de1da7b-f0f0-4b3d-9f57-890c9ae5e62c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Going to try to stop instance {{(pid=129358) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 20:40:50.470550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8de1da7b-f0f0-4b3d-9f57-890c9ae5e62c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action" status: 202 len: 0 microversion: 2.1 time: 0.317667 May 12 20:40:50.471440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 252/462] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:40:50 2022] POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:40:50.480106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:50.481096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:50.488287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:50.491768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:50.491768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:50.491768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:50.600734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:50.601499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:50.609878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:50.610452 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:50.611561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:50.614649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:50.673573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:50.683749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-44c17311-0af6-4635-b7c9-02845e62940a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.208019 May 12 20:40:50.690088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 211/463] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:50 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:50.821653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:50.834074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:50.835896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:50.840845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c06efbfb-56c7-487c-923d-652bbf0a7aa4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1753 microversion: 2.20 time: 0.244264 May 12 20:40:50.842332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 253/464] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:50 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:51.047867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-87707a8a-2f18-4fc6-a7be-2cea749b0751 req-251fb2af-26ff-4443-b061-c5d2e4326fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0592bc35-ec6e-4ccb-b2e5-39184df8c10d", "tag": "a0106765-c4b4-4cc4-b53a-c2dd3a5e223b"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:40:51.057791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-87707a8a-2f18-4fc6-a7be-2cea749b0751 req-251fb2af-26ff-4443-b061-c5d2e4326fc7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:51.062687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-87707a8a-2f18-4fc6-a7be-2cea749b0751 req-251fb2af-26ff-4443-b061-c5d2e4326fc7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:51.078623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-87707a8a-2f18-4fc6-a7be-2cea749b0751 req-251fb2af-26ff-4443-b061-c5d2e4326fc7 service nova] Creating event network-changed:a0106765-c4b4-4cc4-b53a-c2dd3a5e223b for instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d on hv-cinder-81565 May 12 20:40:51.086571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-87707a8a-2f18-4fc6-a7be-2cea749b0751 req-251fb2af-26ff-4443-b061-c5d2e4326fc7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042084 May 12 20:40:51.091448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 212/465] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:40:51.702038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:51.703421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:51.714675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:51.716145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:51.717701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:51.718300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:51.865775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:51.866522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:51.885020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:51.885505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:51.886298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:51.886743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:52.115905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:52.125372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bffd7b95-9749-46b7-b238-84d6d3b1d6f3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.427201 May 12 20:40:52.135458 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 254/466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:51 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:52.179478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:52.196592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:52.203818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:52.210069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9bdfec22-d740-4e81-911f-04f8d67900ee tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.349367 May 12 20:40:52.216885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 213/467] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:51 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:40:53.145465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:53.147633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:53.155930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:53.157615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:53.158725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:53.159441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:53.229709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:53.230680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:53.242297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:53.242838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:53.243741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:53.244420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:53.345253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:53.358721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f0f6c77d-627a-4c84-8b22-1fffef0eecbc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.217845 May 12 20:40:53.360608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 255/468] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:53 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:53.531583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:53.545224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:53.558549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:53.565030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1552a887-cbc0-4d7b-be7f-d295d97772ea tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.339716 May 12 20:40:53.578611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 214/469] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:53 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:54.418255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:54.421851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:54.448332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:54.508423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:54.508423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:54.508423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:54.600121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:54.601953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:54.610470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:54.611279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:54.612498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:54.613295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:54.720387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:54.731063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a0220f34-c416-4e0e-8caa-892b8fc447b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.325374 May 12 20:40:54.731063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 256/470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:54 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:54.890840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:54.910351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:54.912427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:54.914270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6ff0457c-3507-4c3d-84eb-6ab328bde4c5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.320317 May 12 20:40:54.924374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 215/471] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:54 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:55.748970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:55.750170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:55.760410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:55.760862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:55.761746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:55.770284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:55.936208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:55.938267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:55.953307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:55.954055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:55.955874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:55.956322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:56.005878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:56.021307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8153cf4f-8104-497c-a692-c83c361f6459 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.276236 May 12 20:40:56.032855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 257/472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:55 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:56.133034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:56.142326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:56.144540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:56.145983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-309cafc5-a41f-4484-9478-c6c898c4a62e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.214545 May 12 20:40:56.146987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 216/473] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:55 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:57.039871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:57.040469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:57.047171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:57.047615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:57.048373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:57.048807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:57.166189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:57.167574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:57.178810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:57.179560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:57.180492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:57.181079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:57.196568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:57.206605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d144ffe2-c93d-4ec4-98a4-f867e28d30ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.170501 May 12 20:40:57.217064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 258/474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:57 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:57.343156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:57.351625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:57.353204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:57.354653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a9afaada-0750-4413-b413-b424ab9f18b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.192954 May 12 20:40:57.355291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 217/475] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:57 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:58.223990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:58.224817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:58.238565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:58.239260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:58.240160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:58.240593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:58.374189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:58.374691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:58.382772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:58.383229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:58.384024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:58.384457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:58.405121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:58.413464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-049c109e-e57d-4047-8623-1a4861803319 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.193226 May 12 20:40:58.414103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 259/476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:58 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:58.543994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:58.552414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:58.553962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:58.555122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-66bfdf91-b42c-48d4-8bf2-cc2d36b99d92 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.185234 May 12 20:40:58.555677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 218/477] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:58 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:40:59.432562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:59.433851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:59.440743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:59.441911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:59.446574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:59.447209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:59.578817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:40:59.579609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:40:59.588787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:59.592954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:59.593926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:40:59.594380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:40:59.665896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:59.674758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-17f4a98b-f159-4034-a8d1-178fd85cd722 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.246707 May 12 20:40:59.677640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 260/478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:40:59 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:40:59.771157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:59.782040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:59.783949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:40:59.785345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e87112cf-2245-4621-be44-7278c325fcd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.213917 May 12 20:40:59.786448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 219/479] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:40:59 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:00.699537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:00.700359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:00.707204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:00.708714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:00.708714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:00.708919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:00.807056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:00.807826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:00.815313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:00.817679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:00.817679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:00.817679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:00.849245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:00.859273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-211f27a6-ec66-4d8a-91c2-17a99f1a62a2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.169147 May 12 20:41:00.860618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 261/480] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:00 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:00.985161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:00.993915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:00.998288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:00.998288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cd264128-f223-4a26-a862-cecc55549d48 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.193533 May 12 20:41:00.998288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 220/481] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:00 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:01.880946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:01.881576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:01.887600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:01.889220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:01.890234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:01.890820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:02.016164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:02.017511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:02.025475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:02.026378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:02.027292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:02.028046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:02.075062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:02.099376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd7b227e-b226-40d1-9a98-b9680cb2767f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.227030 May 12 20:41:02.100473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 262/482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:01 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:02.196109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:02.206140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:02.208134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:02.209625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-644c3629-c6b2-4981-a4f0-1974af1dc4bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.198081 May 12 20:41:02.220474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 221/483] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:02 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:03.116407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:03.117017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:03.124602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:03.127492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:03.127492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:03.127492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:03.234019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:03.234644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:03.245703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:03.246156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:03.246932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:03.247416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:03.285638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:03.300594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5177561a-fc10-4dc8-928d-fac3d429572e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.188115 May 12 20:41:03.301200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 263/484] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:03 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:03.402381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:03.412467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:03.413426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:03.414594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b6f56cb9-5317-4a2f-843c-131b37627eeb tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.185327 May 12 20:41:03.415858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 222/485] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:03 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:04.317985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:04.318748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:04.325547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:04.326294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:04.328678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:04.329132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:04.435393 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:04.436657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:04.443926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:04.444372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:04.445157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:04.445619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:04.467659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:04.475675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-41d54764-14bb-48a0-bf47-a26055182a54 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.161469 May 12 20:41:04.476329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 264/486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:04 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:04.574906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:04.583777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:04.585311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:04.586508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eb0dda35-e607-47d2-a898-8fd20b5c8f8b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.156486 May 12 20:41:04.587071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 223/487] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:04 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:05.493838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:05.494502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:05.501244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:05.501758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:05.502520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:05.502953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:05.605897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:05.607339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:05.613540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:05.614080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:05.614893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:05.615331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:05.643384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:05.651520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46b6351f-854d-480d-b895-fb597696b01d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.161568 May 12 20:41:05.652322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 265/488] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:05 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:05.778442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:05.786693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:05.788199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:05.789385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-80b7ac86-7329-4baa-bcec-4758ab9b1528 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.188720 May 12 20:41:05.789964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 224/489] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:05 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:06.344225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e5a10b-da02-4d6f-8a30-8696e9d1b798"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:06.345617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:06.351630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.352076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.352830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.353255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.563545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:06.564163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:06.570297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.570755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.571529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.571970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.701017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:06.708751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e4cf833e-88f8-497a-b9d6-5c16dc8c4df1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1593 microversion: 2.1 time: 0.149457 May 12 20:41:06.709331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 225/490] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:06 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:06.718105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:06.718705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:06.724864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.726692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.727455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.727939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.874913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:06.894467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f45defeb-01c5-4b6e-b74c-023803d65150 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.180347 May 12 20:41:06.895043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 226/491] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:06 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:06.908912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:06.908912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:06.915718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.916188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:06.917180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:06.917821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:07.057482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:07.067891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:07.069630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:07.070825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ff5eae59-e827-4110-8c26-8d6188a727a3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.172910 May 12 20:41:07.071380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 227/492] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:06 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:07.128028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-965b515c-63ac-44ad-bf0f-3ff76224b73a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788091 May 12 20:41:07.128897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 266/493] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:41:06 2022] POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments => generated 194 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:07.912942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:07.913600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:07.921208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:07.921803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:07.922606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:07.923045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:08.093472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:08.094213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:08.101393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:08.101881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:08.102754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:08.103186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:08.255609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:08.264826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:08.266360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:08.267516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1f682d40-f643-48dd-b531-75a5f9fa9c03 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.181539 May 12 20:41:08.268239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 267/494] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:08 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:08.307391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:08.315306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-57d4aaf7-626f-4c56-9bc3-47d307801988 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1725 microversion: 2.1 time: 0.407228 May 12 20:41:08.315936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 228/495] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:07 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:09.285528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:09.286138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:09.292737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.293410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.294303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.294740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.333590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:09.333979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:09.340422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.341078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.342314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.342719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.502536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:09.520960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:09.522780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:09.524338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fb125106-440e-425b-840f-c9c55a108e25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.242328 May 12 20:41:09.525047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 268/496] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:09 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:09.531857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-e1b5a042-e35b-4c0d-a78a-68dfd679b9a9 req-a1b05832-e76a-4c0c-9b3c-25ae01a4bfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:09.542627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e1b5a042-e35b-4c0d-a78a-68dfd679b9a9 req-a1b05832-e76a-4c0c-9b3c-25ae01a4bfd7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.546290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e1b5a042-e35b-4c0d-a78a-68dfd679b9a9 req-a1b05832-e76a-4c0c-9b3c-25ae01a4bfd7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.554266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:09.561605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-e1b5a042-e35b-4c0d-a78a-68dfd679b9a9 req-a1b05832-e76a-4c0c-9b3c-25ae01a4bfd7 service nova] Creating event network-changed:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:41:09.562721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a746f425-7501-4cfd-8b9c-59406e04a41e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1702 microversion: 2.1 time: 0.234188 May 12 20:41:09.564324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 229/497] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:09 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1702 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:09.568792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-e1b5a042-e35b-4c0d-a78a-68dfd679b9a9 req-a1b05832-e76a-4c0c-9b3c-25ae01a4bfd7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042382 May 12 20:41:09.569527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 269/498] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:09.581558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-38ff1863-8817-468f-9b8e-2480d06b93f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:09.588735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38ff1863-8817-468f-9b8e-2480d06b93f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.589204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38ff1863-8817-468f-9b8e-2480d06b93f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.662974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-38ff1863-8817-468f-9b8e-2480d06b93f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Going to try to start instance {{(pid=129357) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 20:41:09.847194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-38ff1863-8817-468f-9b8e-2480d06b93f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action" status: 202 len: 0 microversion: 2.1 time: 0.268527 May 12 20:41:09.848274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 230/499] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:41:09 2022] POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:41:09.858864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:09.860020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:09.870978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.872211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:09.872610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:09.873070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:10.026426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:10.035991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-678022a3-ba6c-43aa-b863-aa7ca4c96492 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1711 microversion: 2.1 time: 0.182730 May 12 20:41:10.036819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 270/500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:09 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1711 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:10.544694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:10.551915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:10.560882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:10.566481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:10.566481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:10.566481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:10.907177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:10.915751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:10.917719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:10.923236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0b05d92e-e30f-4e8e-8206-e31190f6879e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.383747 May 12 20:41:10.926885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 231/501] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:10 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:11.052652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:11.053537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:11.060023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:11.060565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:11.061438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:11.062133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:11.195679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:11.204538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e45a62d-4f57-41ca-a75e-b6383688d411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1711 microversion: 2.1 time: 0.155690 May 12 20:41:11.205313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 271/502] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:11 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:11.945491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:11.946110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:11.954159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:11.954619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:11.955406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:11.955968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.118619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:12.127903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:12.129911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:12.131145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aa2a0296-84e5-42b5-b9a7-baa98e5269bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.190000 May 12 20:41:12.131705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 232/503] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:11 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:12.222668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:12.223302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:12.229611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:12.230059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.230820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:12.231317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.354484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-486459844"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:12.355020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:12.362181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:12.362636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.363418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:12.363906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.365679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:12.373848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14daba30-486d-4ba6-8431-37cdf0100300 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1711 microversion: 2.1 time: 0.155011 May 12 20:41:12.374430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 272/504] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:12 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:12.505661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.network.security_group_api [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Adding security group 89e868b7-3795-4b56-b001-5ec54aa8c979 to port 57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 May 12 20:41:12.700409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-df114f8e-c167-4622-b1ff-eb3362d7f271 req-d57d606d-6145-4ef2-af8e-9feb86d5db4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "name": "network-vif-plugged", "status": "completed", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:12.710184 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-df114f8e-c167-4622-b1ff-eb3362d7f271 req-d57d606d-6145-4ef2-af8e-9feb86d5db4b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:12.710633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-df114f8e-c167-4622-b1ff-eb3362d7f271 req-d57d606d-6145-4ef2-af8e-9feb86d5db4b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:12.722300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-df114f8e-c167-4622-b1ff-eb3362d7f271 req-d57d606d-6145-4ef2-af8e-9feb86d5db4b service nova] Creating event network-vif-plugged:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:41:12.727467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-df114f8e-c167-4622-b1ff-eb3362d7f271 req-d57d606d-6145-4ef2-af8e-9feb86d5db4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030887 May 12 20:41:12.728425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 273/505] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:41:13.015455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49dc7155-130d-4953-abec-9507267cf053 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action" status: 202 len: 0 microversion: 2.1 time: 0.664875 May 12 20:41:13.017322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 233/506] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:41:12 2022] POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:41:13.026514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:13.027375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:13.029505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-fbcb552c-a45c-4509-8a7f-9958a58dfe08 req-fcefb3de-2ded-4d68-8583-0566f4b8a820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:13.036388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.037248 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.042939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.043411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.051251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fbcb552c-a45c-4509-8a7f-9958a58dfe08 req-fcefb3de-2ded-4d68-8583-0566f4b8a820 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.051691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fbcb552c-a45c-4509-8a7f-9958a58dfe08 req-fcefb3de-2ded-4d68-8583-0566f4b8a820 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.086952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-fbcb552c-a45c-4509-8a7f-9958a58dfe08 req-fcefb3de-2ded-4d68-8583-0566f4b8a820 service nova] Creating event network-changed:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:41:13.089906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-fbcb552c-a45c-4509-8a7f-9958a58dfe08 req-fcefb3de-2ded-4d68-8583-0566f4b8a820 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063029 May 12 20:41:13.094094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 234/507] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:13.150661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:13.151377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:13.165070 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.165569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.166362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.166808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.331656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:13.339688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-07e9cfe6-0895-4756-9c6e-b05aeaa38295 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1757 microversion: 2.1 time: 0.318154 May 12 20:41:13.340263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 274/508] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:13 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1757 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:13.401943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:13.402592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:13.418189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.418645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.419899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:13.422435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:13.480783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:13.505377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:13.506896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:13.508303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-77b9690b-a0f8-4cc6-bdfc-93cca8992ec5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.362297 May 12 20:41:13.512109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 235/509] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:13 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:13.657262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:13.665239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2ef7f0eb-bc69-4aac-8fce-1c9864572ddf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1715 microversion: 2.1 time: 0.273575 May 12 20:41:13.666079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 275/510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:13 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1715 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:14.527943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:14.529496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:14.535755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:14.536202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:14.536971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:14.537442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:14.670333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:14.678898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:14.680476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:14.681753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8831c8f2-aa6b-4e50-a8a5-95c6133aff36 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.157795 May 12 20:41:14.682391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 236/511] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:14 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:41:15.699922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:15.700585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:15.707018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:15.707474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:15.708292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:15.708736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:15.848262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:15.857532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:15.859113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:15.860269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6944f172-0d33-4c34-8fa4-fd30d4741ea7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.164332 May 12 20:41:15.860832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 276/512] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:15 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:16.803118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:16.804060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:16.810749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:16.811241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:16.812047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:16.812484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:16.844823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'flavor' on Instance uuid ac1f7b3f-92ec-4533-872e-e7886f43d138 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:41:16.881481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:16.882237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:16.892579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:16.893607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:16.894976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:16.896058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:17.070818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:17.080477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:17.082007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:17.083319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-565c9a3c-703d-4735-8b46-55c24966750e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1809 microversion: 2.20 time: 0.207812 May 12 20:41:17.083868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 277/513] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:16 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:17.240320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9c3b9201-2e81-4952-9704-1021b1c7cef3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/action" status: 200 len: 32 microversion: 2.1 time: 0.441227 May 12 20:41:17.240964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 237/514] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:41:16 2022] POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:41:17.250453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:17.251059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:17.257419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:17.257869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:17.258643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:17.259075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:17.395943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:17.405656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91bb7aa0-c76b-48a4-a6f9-13fb8b1cd506 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.159222 May 12 20:41:17.406761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 278/515] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:17 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:18.103888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:18.108145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:18.111518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:18.111962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:18.112715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:18.113145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:18.249436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:18.258099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:18.259615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:18.260825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-32b6ec54-aec5-4c07-98e3-2168b5d291de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1796 microversion: 2.20 time: 0.161703 May 12 20:41:18.261426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 238/516] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:41:18 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:41:18.423471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:18.423992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:18.430669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:18.431172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:18.432004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:18.432441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:18.569037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:18.577748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ca8a7b24-2ae2-4f39-9bf2-39bba239b270 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.158188 May 12 20:41:18.578309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 279/517] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:18 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:19.595399 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:19.596129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:19.602520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:19.602969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:19.603730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:19.604171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:19.734631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:19.742690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-48861d14-d369-4521-8272-8c54bf6356c2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.151862 May 12 20:41:19.743617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 239/518] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:19 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:20.760490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:20.761093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:20.767625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:20.768077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:20.768827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:20.769262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:20.900001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:20.907817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc164dbf-3377-4e83-ba49-5b84c970312a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.151127 May 12 20:41:20.908379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 280/519] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:20 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:21.924949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:21.925686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:21.932321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:21.932769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:21.933586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:21.934022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:22.063049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:22.070872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d36785d3-13b0-4b82-ab13-d39da36663f1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.149917 May 12 20:41:22.071427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 240/520] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:21 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:23.088383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:23.089000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:23.096200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:23.096653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:23.097535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:23.097976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:23.229094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:23.236875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a76effe7-9726-4c16-ab32-6a8c59b32fb1 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.152377 May 12 20:41:23.237460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 281/521] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:23 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:24.254726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:24.255298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:24.261625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:24.262070 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:24.262824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:24.263949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:24.395814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:24.405078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-00d42a1b-f070-487d-8d71-a6a58b84b612 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.153124 May 12 20:41:24.405855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 241/522] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:24 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:25.423003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:25.423605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:25.429875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:25.430316 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:25.431066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:25.431501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:25.561429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:25.569158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-89445f18-4832-4ef2-a212-9db09b76a132 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.150589 May 12 20:41:25.569752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 282/523] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:25 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:26.585919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:26.586660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:26.593100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:26.593581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:26.594345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:26.594798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:26.725055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:26.733409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-954063f6-da9a-4120-9805-e3eed3652cc4 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.151330 May 12 20:41:26.734189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 242/524] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:26 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:27.750892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:27.751497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:27.761455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:27.761904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:27.762668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:27.763098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:28.122539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:28.131171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3c5df9bd-cf13-4b94-b1c0-b5d5124ca2c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.384970 May 12 20:41:28.131728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 283/525] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:27 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:29.148716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:29.149390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:29.155739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:29.156195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:29.156975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:29.157446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:29.297618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:29.305428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f3d85c83-3316-4d23-995c-d7c354dfbd86 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.160580 May 12 20:41:29.305998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 243/526] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:29 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:30.326825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:30.327798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:30.335291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:30.335864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:30.336696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:30.337220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:30.468133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:30.476198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7811e815-dd36-417a-a19a-6373c73ba824 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.156601 May 12 20:41:30.476765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 284/527] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:30 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:31.494848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:31.495395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:31.501872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:31.502320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:31.503086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:31.503527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:31.634855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:31.642678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5f1aa114-3d30-4493-a45c-a3352eaafbc3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.152486 May 12 20:41:31.643238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 244/528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:31 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:32.661535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:32.662150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:32.668568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:32.669009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:32.669817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:32.670251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:32.801729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:32.810044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8b327699-db5f-476f-8807-713c498e4642 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.152328 May 12 20:41:32.810632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 285/529] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:32 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:33.827730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:33.828619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:33.834961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:33.835413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:33.836178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:33.836616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:33.974468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:33.982443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfaa8dd9-7eb2-443b-958b-c203f29cee28 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.158527 May 12 20:41:33.983013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 245/530] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:33 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:34.999580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:35.000178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:35.007919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:35.008356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:35.009108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:35.009658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:35.139674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:35.147805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d4b67550-99ce-44d6-b4e7-c4e4ad86f7f0 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.152014 May 12 20:41:35.148371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 286/531] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:34 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:36.165032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:36.165643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:36.171879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:36.172579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:36.174649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:36.175548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:36.313204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:36.321636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2449d89e-5d98-4140-b4e1-3c437df19952 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1734 microversion: 2.1 time: 0.160669 May 12 20:41:36.323194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 246/532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:36 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:37.339919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:37.340560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:37.347335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.347823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.348664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.349167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.478902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:37.487279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-85145cb2-7c06-4e57-b0d2-f825d7882d0c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1714 microversion: 2.1 time: 0.151277 May 12 20:41:37.497737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 287/533] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:37 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:37.589612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:37.590144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:37.597791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.598244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.599657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.600094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.725594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] HTTP exception thrown: Cannot 'detach_volume' instance ac1f7b3f-92ec-4533-872e-e7886f43d138 while it is in vm_state rescued May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Request method failure captured: May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments/09e5a10b-da02-4d6f-8a30-8696e9d1b798 HTTP/1.1 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz1nlroBCS0z9CAFGhOAWRaQrvgY3sdBRyvmLUWpqZRCr4DZ6SqTkMaldH6lEflE8tNJvN1W1-kIe50dc6LkQB5FPvsJXGfRn5qbZZoiBz9xG66YcTprXNYFPtttmGCcDp8kjNkb4tAvIbUatUy3rwt0HG1EU_iza49vMuuHTKSQw May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:41:37.727212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_500b58188f1a4a088b52b67eb5772984", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 2a2b95ccb7804311a011f37ccb371771 May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:41:37.728722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Cannot 'detach_volume' instance ac1f7b3f-92ec-4533-872e-e7886f43d138 while it is in vm_state rescued May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': 'ac1f7b3f-92ec-4533-872e-e7886f43d138', 'id': '09e5a10b-da02-4d6f-8a30-8696e9d1b798'} May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:41:37.729515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ac1f7b3f-92ec-4533-872e-e7886f43d138 while it is in vm_state rescued May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ac1f7b3f-92ec-4533-872e-e7886f43d138 while it is in vm_state rescued May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:37.730892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Returning 409 to user: Cannot 'detach_volume' instance ac1f7b3f-92ec-4533-872e-e7886f43d138 while it is in vm_state rescued {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:41:37.732047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d7190c4a-fef3-4d0d-ad8e-f2397209054a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments/09e5a10b-da02-4d6f-8a30-8696e9d1b798" status: 409 len: 152 microversion: 2.1 time: 0.143159 May 12 20:41:37.732047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 247/534] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:41:37 2022] DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments/09e5a10b-da02-4d6f-8a30-8696e9d1b798 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 20:41:37.737504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:37.738033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:37.743846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.744294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.745050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.745511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.948864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3afcb004-e4e7-4fc4-bf36-f86d5c5c115c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/action" status: 202 len: 0 microversion: 2.1 time: 0.215058 May 12 20:41:37.949533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 288/535] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:41:37 2022] POST /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:41:37.958892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:37.960101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:37.969186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.969754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:37.970793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:37.971232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:38.139989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:38.148108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-324ba17e-b2fd-4e87-8b33-2af29df12aee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1722 microversion: 2.1 time: 0.194303 May 12 20:41:38.148681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 248/536] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:37 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:39.166192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:39.166867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:39.175099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:39.175549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:39.176332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:39.176768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:39.309959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:39.317669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d0263654-db02-4cb3-a6f0-4d6658b76465 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1722 microversion: 2.1 time: 0.156484 May 12 20:41:39.318231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 289/537] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:39 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:40.336458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:40.337114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:40.345150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:40.349636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:40.349636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:40.349636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:40.483596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:40.492683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f3765ed-8ac1-4e20-a926-5cbeb88b997a tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1722 microversion: 2.1 time: 0.162004 May 12 20:41:40.496756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 249/538] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:40 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:41.510864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:41.511455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:41.517811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:41.518392 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:41.519168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:41.519602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:41.649945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:41.657710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-872e2a9f-d3e4-49d5-964f-e7bd187335db tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1722 microversion: 2.1 time: 0.150754 May 12 20:41:41.658268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 290/539] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:41 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:42.675555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:42.676173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:42.683391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.683847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.684623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.685064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.822237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:42.830056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d1264b78-e4ec-4df0-b34c-a12c81fcb726 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1728 microversion: 2.1 time: 0.158373 May 12 20:41:42.830613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 250/540] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:42 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:42.846448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:42.846957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:42.853429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.853887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.854655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.855093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.873505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:42.874533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:42.881399 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.881802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.882568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:42.883003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:42.932595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-346ae610-0191-4b0d-a733-958a4f1d576d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089509 May 12 20:41:42.932595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 291/541] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:41:42 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:43.103866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0b4b81c7-a39b-4b88-9c1b-6d7bdcc58bc1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action" status: 202 len: 0 microversion: 2.1 time: 0.234018 May 12 20:41:43.109310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 251/542] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:41:42 2022] POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:41:43.112681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:43.113343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:43.127962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:43.128412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:43.129358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:43.130157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:43.418831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:43.427528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-97a57d61-863a-402b-b463-cd5ec99b9e52 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1749 microversion: 2.1 time: 0.318001 May 12 20:41:43.428953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 292/543] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:43 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1749 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:44.079757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-128fbbee-721f-4dec-b863-dc4f3a40f572 req-82a720f3-8208-4210-8dab-d54d09f908e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:44.091782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-128fbbee-721f-4dec-b863-dc4f3a40f572 req-82a720f3-8208-4210-8dab-d54d09f908e5 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:44.092373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-128fbbee-721f-4dec-b863-dc4f3a40f572 req-82a720f3-8208-4210-8dab-d54d09f908e5 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:44.104333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-128fbbee-721f-4dec-b863-dc4f3a40f572 req-82a720f3-8208-4210-8dab-d54d09f908e5 service nova] Creating event network-changed:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:41:44.109141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-128fbbee-721f-4dec-b863-dc4f3a40f572 req-82a720f3-8208-4210-8dab-d54d09f908e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034235 May 12 20:41:44.109757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 252/544] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:44.448857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:44.450542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:44.465207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:44.466065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:44.466982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:44.467947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:44.618484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:44.626724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7fa252c7-876e-4324-a606-bafc412383a5 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.184422 May 12 20:41:44.627446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 293/545] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:44 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:45.645414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:45.647119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:45.653711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:45.654164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:45.654934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:45.655371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:45.797417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:45.805363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9befcec4-803d-44fc-9db3-3f25eec64c56 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.164110 May 12 20:41:45.805924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 253/546] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:45 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:46.123839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-84cf7eab-7a98-4154-b820-5b15b61ec213 req-e85eee92-87c9-4639-8ba1-e32f3230e9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:46.132542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-84cf7eab-7a98-4154-b820-5b15b61ec213 req-e85eee92-87c9-4639-8ba1-e32f3230e9e8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:46.132979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-84cf7eab-7a98-4154-b820-5b15b61ec213 req-e85eee92-87c9-4639-8ba1-e32f3230e9e8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:46.143698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-84cf7eab-7a98-4154-b820-5b15b61ec213 req-e85eee92-87c9-4639-8ba1-e32f3230e9e8 service nova] Creating event network-changed:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:41:46.148533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-84cf7eab-7a98-4154-b820-5b15b61ec213 req-e85eee92-87c9-4639-8ba1-e32f3230e9e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028297 May 12 20:41:46.149090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 294/547] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:46.822798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:46.823337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:46.829542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:46.829991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:46.830755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:46.831188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:46.971475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:46.979941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a663698e-347b-4ca8-8f49-aa8f2bc4c3c7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.161145 May 12 20:41:46.980503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 254/548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:46 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:47.174255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:47.174839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:47.181804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.182250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.183008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.183441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.205516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-67a120bc-348a-48a4-83a3-a8656153f24c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035958 May 12 20:41:47.206065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 295/549] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:41:47 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:47.217018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30023ea7-f857-4266-94e3-a9fcb233d89f"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:47.218206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:47.224772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.225219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.226014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.226451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.304840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: POST /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/os-volume_attachments HTTP/1.1 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 74 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:41:47.306614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {"volumeAttachment": {"volumeId": "30023ea7-f857-4266-94e3-a9fcb233d89f"}} May 12 20:41:47.308188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': '0592bc35-ec6e-4ccb-b2e5-39184df8c10d', 'body': {'volumeAttachment': {'volumeId': '30023ea7-f857-4266-94e3-a9fcb233d89f'}}} May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:47.309086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:47.310297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 400 to user: Invalid volume: volume 30023ea7-f857-4266-94e3-a9fcb233d89f is already attached to instances: 8d5aa200-1fb8-4cde-b379-333b9b415aef {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0a6b8182-fd55-493c-9225-e6845f207519 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095037 May 12 20:41:47.311415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 255/550] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:41:47 2022] POST /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:41:47.317004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:47.318149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:47.324001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.324454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.325208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.325743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.349660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:41:47.726003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cb46737b-4baf-4073-af2e-a10af0ba9053 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 204 len: 0 microversion: 2.1 time: 0.412455 May 12 20:41:47.726604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 296/551] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:41:47 2022] DELETE /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:41:47.734782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:47.735395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:47.744260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.744710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.745569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:47.746034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:47.877985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:47.885623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9b124b0e-689d-48d7-acec-7c8720d15db4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1679 microversion: 2.1 time: 0.154710 May 12 20:41:47.886176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 256/552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:47 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:47.998117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:47.998737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:48.004961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:48.005561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:48.006278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:48.006715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:48.155816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:48.164471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d273b4c1-708a-4a9a-b6df-ba0e51e343e9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.170628 May 12 20:41:48.165029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 297/553] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:47 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:48.902847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:48.903466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:48.909786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:48.910230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:48.910980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:48.912104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:49.039426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:49.046648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-409d4ead-3c45-46af-818e-85aab243dbb8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1679 microversion: 2.1 time: 0.147629 May 12 20:41:49.047200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 257/554] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:48 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:49.181127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:49.181780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:49.188134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:49.188592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:49.189390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:49.189852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:49.332919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:49.341640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c56f58e5-35b8-4a15-9f0d-3c912a30c13a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.164303 May 12 20:41:49.342241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 298/555] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:49 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:50.065161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:50.065871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:50.073385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:50.077524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:50.077524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:50.077524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:50.236012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:50.243977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ca6c1139-b4e5-4140-b28e-15f796ceae0c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1679 microversion: 2.1 time: 0.183391 May 12 20:41:50.244538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 258/556] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:50 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:50.358692 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:50.359347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:50.377592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:50.377592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:50.377592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:50.377592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:50.531856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:50.542745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b6381728-6f40-48cf-b303-84782fe10b49 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.187849 May 12 20:41:50.544098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 299/557] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:50 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:50.598500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-b622f1cc-ade9-468a-982e-6273c6d646b1 req-a9a57d25-aace-4c19-bb78-f021c9e0b24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0592bc35-ec6e-4ccb-b2e5-39184df8c10d", "name": "network-vif-deleted", "tag": "a0106765-c4b4-4cc4-b53a-c2dd3a5e223b"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:50.607442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-b622f1cc-ade9-468a-982e-6273c6d646b1 req-a9a57d25-aace-4c19-bb78-f021c9e0b24b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:50.608515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-b622f1cc-ade9-468a-982e-6273c6d646b1 req-a9a57d25-aace-4c19-bb78-f021c9e0b24b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:50.620744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-b622f1cc-ade9-468a-982e-6273c6d646b1 req-a9a57d25-aace-4c19-bb78-f021c9e0b24b service nova] Creating event network-vif-deleted:a0106765-c4b4-4cc4-b53a-c2dd3a5e223b for instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d on hv-cinder-81565 May 12 20:41:50.626057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-b622f1cc-ade9-468a-982e-6273c6d646b1 req-a9a57d25-aace-4c19-bb78-f021c9e0b24b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033088 May 12 20:41:50.627176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 259/558] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:51.262247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:51.262859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:51.269558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:51.270004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:51.270809 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:51.272046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:51.328342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:51.328780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:51.329440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'fault' on Instance uuid 0592bc35-ec6e-4ccb-b2e5-39184df8c10d {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:41:51.378061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:51.388226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6af3f6d9-c19b-420a-997d-68b4bff4ccf1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 200 len: 1329 microversion: 2.1 time: 0.129773 May 12 20:41:51.388900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 300/559] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:51 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:51.562971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:51.565339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:51.572796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:51.573251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:51.574050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:51.574660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:51.749973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:51.759403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-69fa1cec-8c10-4fc9-82ac-c5b767bd9a05 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.201552 May 12 20:41:51.759965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 260/560] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:51 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:52.405412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:52.406032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:52.412995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:52.413535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:52.414315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:52.414755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:52.428498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d HTTP/1.1 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:41:52.430291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 20:41:52.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '0592bc35-ec6e-4ccb-b2e5-39184df8c10d'} May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:41:52.432526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 20:41:52.433701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:41:52.434779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:41:52.434779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08fe47ed-f56d-41bb-a116-86cbb559755b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 404 len: 111 microversion: 2.1 time: 0.030321 May 12 20:41:52.434779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 301/561] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:52 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:41:52.441280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4631dd93-2979-451d-8860-4c89643c1810 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '.version_select at 0x7f4e62e4a940>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:52.567106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4631dd93-2979-451d-8860-4c89643c1810 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266665292" status: 202 len: 0 microversion: 2.1 time: 0.129348 May 12 20:41:52.568054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 261/562] 10.222.0.59 () {58 vars in 1217 bytes} [Thu May 12 20:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266665292 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:41:52.777742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:52.778360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:52.784489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:52.785524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:52.785780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:52.786180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:52.958729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:52.967431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6823eb2d-dde3-4812-bbc8-f0a7f3452089 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.193837 May 12 20:41:52.968000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 302/563] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:52 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:53.406115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:53.406587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:53.414067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.414521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:53.415315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.415759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:53.498167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'services' on Instance uuid 8d5aa200-1fb8-4cde-b379-333b9b415aef {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:41:53.753128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e6e414c9-3c61-4a6e-9e49-0ebcb9ea3662 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments/30023ea7-f857-4266-94e3-a9fcb233d89f" status: 202 len: 0 microversion: 2.1 time: 0.351689 May 12 20:41:53.753802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 262/564] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:41:53 2022] DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments/30023ea7-f857-4266-94e3-a9fcb233d89f => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:41:53.764848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:53.766090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:53.772844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.773323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:53.774104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.774539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:53.803022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5af5162e-1383-4636-96b8-988401fb11d9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 May 12 20:41:53.803580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 303/565] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:41:53 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:53.985410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:53.986117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:53.993452 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.993863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:53.994625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:53.995060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:54.139666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:54.152166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-513d9c09-bb55-4c81-be59-d95e8d3e3650 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.167681 May 12 20:41:54.152166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 263/566] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:53 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:54.814635 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:54.815563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:54.821922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:54.822383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:54.823143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:54.823582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:54.853627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3b9db9ee-cb91-4b79-a9d2-8729ae8685a3 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 May 12 20:41:54.854175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 304/567] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:41:54 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:55.166762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:55.167354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:55.174021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.174466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.175268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.175704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.322781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:55.330688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3327b623-769c-453e-abde-c68e82a7872e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.168039 May 12 20:41:55.337397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 264/568] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:55 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:55.866362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:55.868034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:55.874671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.875213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.875984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.876516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.906051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-55a1d61d-ff38-478e-af79-9d16805a340d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044602 May 12 20:41:55.906613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 305/569] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:41:55 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:41:55.965103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:55.965708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:55.971739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.972302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.973151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:55.973658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:55.999043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:41:56.287413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3434f8b5-633c-4868-ae1a-f4c09af3f130 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 204 len: 0 microversion: 2.1 time: 0.326143 May 12 20:41:56.288046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 265/570] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:41:55 2022] DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:41:56.297015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:56.297661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:56.303534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:56.303984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:56.304928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:56.305388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:56.348615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:56.349360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:56.358967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:56.359428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:56.360221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:56.360664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:56.453376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:56.461766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-121c30d8-e961-41f2-8a80-e1d0d36cb468 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1680 microversion: 2.1 time: 0.168350 May 12 20:41:56.462493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 306/571] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:56 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:56.516414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:56.525409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b1eb1937-9f73-4b96-a436-84b4793551d1 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.181057 May 12 20:41:56.525986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 266/572] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:56 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:57.479998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:57.480560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:57.486941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:57.487396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:57.488157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:57.488593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:57.542993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:57.543735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:57.550312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:57.550763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:57.551597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:57.552038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:57.626271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:57.634474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ccd55e7f-4d11-4dda-8422-8f401cf5df98 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1680 microversion: 2.1 time: 0.158937 May 12 20:41:57.635987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 307/573] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:57 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:57.700920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:57.708669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5fb33c95-961f-4719-9d93-28d10ba483e2 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.170574 May 12 20:41:57.709229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 267/574] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:57 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:41:58.652645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:58.653373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:58.659840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:58.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:58.661072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:58.661541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:58.728284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:58.730937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:58.740913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:58.743143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:58.744342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:58.745377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:58.819113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:58.827233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8c8a411f-da32-4a59-9899-0dc6444315c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1680 microversion: 2.1 time: 0.179298 May 12 20:41:58.827810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 308/575] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:58 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:59.013842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:59.021581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-656493ad-64fe-4977-85b0-10295df5d0c9 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.298481 May 12 20:41:59.023317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 268/576] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:58 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:41:59.420629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-32e7208c-9095-4e2e-bec2-be0909731a93 req-bb52185f-3e44-47cb-b6c5-372773933497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5aa200-1fb8-4cde-b379-333b9b415aef", "name": "network-vif-deleted", "tag": "98d4851d-d441-40c6-8745-4065b6b18a3d"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:41:59.428515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-32e7208c-9095-4e2e-bec2-be0909731a93 req-bb52185f-3e44-47cb-b6c5-372773933497 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:59.428955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-32e7208c-9095-4e2e-bec2-be0909731a93 req-bb52185f-3e44-47cb-b6c5-372773933497 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:59.439949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-32e7208c-9095-4e2e-bec2-be0909731a93 req-bb52185f-3e44-47cb-b6c5-372773933497 service nova] Creating event network-vif-deleted:98d4851d-d441-40c6-8745-4065b6b18a3d for instance 8d5aa200-1fb8-4cde-b379-333b9b415aef on hv-cinder-81565 May 12 20:41:59.445415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-32e7208c-9095-4e2e-bec2-be0909731a93 req-bb52185f-3e44-47cb-b6c5-372773933497 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028258 May 12 20:41:59.449329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 309/577] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:41:59.844109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:41:59.844926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:41:59.852057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:59.852825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:59.853428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:59.853898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:59.886767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:41:59.887225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:41:59.887680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'fault' on Instance uuid 8d5aa200-1fb8-4cde-b379-333b9b415aef {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:41:59.932157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:41:59.947872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b2e25643-fae1-4d68-9ab8-ea9ef99ba5a2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1330 microversion: 2.1 time: 0.107612 May 12 20:41:59.948622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 269/578] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:41:59 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:00.040598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:00.041433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:00.048148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:00.048734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:00.049602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:00.050159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:00.197525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:00.205506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-50d95f89-809a-4679-970d-a50898c91816 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1754 microversion: 2.1 time: 0.170349 May 12 20:42:00.208761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 310/579] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:00 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:00.966426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:00.967354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:00.974288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:00.974741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:00.977066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:00.978012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.013251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:01.013646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.014095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'fault' on Instance uuid 8d5aa200-1fb8-4cde-b379-333b9b415aef {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:01.055832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:01.063219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d9dfe7c3-3197-426b-a830-9e3cd2067f58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 200 len: 1330 microversion: 2.1 time: 0.101384 May 12 20:42:01.063795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 270/580] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:00 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:01.222792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:01.223407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:01.230659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:01.231179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.231907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:01.232343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.371432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:01.379170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e124aede-94cf-4f0d-9cd4-25d04d8dd72d tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1757 microversion: 2.1 time: 0.160290 May 12 20:42:01.380161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 311/581] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:01 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:01.446031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-869824433", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:01.494580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] validate_networks() for None {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:42:01.763218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:42:01.763668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:42:01.764135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:42:01.764537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:42:01.764941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:42:01.774847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:01.775289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.776080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:01.776509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:01.792729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Getting quotas for project b2494c982e7f45cba3b28a0ccdf3a83f. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:42:01.796571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Getting quotas for user 9740039be9644eb58b3a12eb021e287d and project b2494c982e7f45cba3b28a0ccdf3a83f. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:42:01.807582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:42:01.809838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:42:01.949908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-23e542ad-cb10-4e13-b2d8-f36fbfa7b0ad tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507759 May 12 20:42:01.950680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 271/582] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:42:01.960411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7ff2ff25-8c3c-4fa9-83d0-22bcd2a3fc71 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:01.962071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7ff2ff25-8c3c-4fa9-83d0-22bcd2a3fc71 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:02.014299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7ff2ff25-8c3c-4fa9-83d0-22bcd2a3fc71 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:02.020849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7ff2ff25-8c3c-4fa9-83d0-22bcd2a3fc71 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1214 microversion: 2.1 time: 0.064250 May 12 20:42:02.021464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 312/583] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:01 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:02.079805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:02.080413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:02.087860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:02.088340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:02.089110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:02.089566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:02.103439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef HTTP/1.1 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:42:02.105084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 20:42:02.106617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '8d5aa200-1fb8-4cde-b379-333b9b415aef'} May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:02.107531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 20:42:02.109052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:02.110430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:02.110430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2bdcc771-2735-4318-a053-fae8aa25f1f6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 404 len: 111 microversion: 2.1 time: 0.030647 May 12 20:42:02.110430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 272/584] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:02 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:02.116780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c3b3b11e-1e2e-4fa6-8a27-648f6de8d5ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '.version_select at 0x7f4e62d85040>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:02.208909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c3b3b11e-1e2e-4fa6-8a27-648f6de8d5ef tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980706035" status: 202 len: 0 microversion: 2.1 time: 0.096925 May 12 20:42:02.230319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 313/585] 10.222.0.59 () {58 vars in 1217 bytes} [Thu May 12 20:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980706035 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:02.967938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3bb960a0-2f52-4ed2-ab1d-0e0e5849c70a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: .version_select at 0x7f4e62e545e0>, body: {"keypair": {"name": "tempest-keypair-1239384042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmz/ElqHK9WxieiGS3PXTv/cvFYbseWvtnlIWEXWAHKUVq7AqrD0/BSaAIbTUaFmC/IdbZMJ+HVVR8OmjTxBByi83V72eRYEL7M+oSTzCPQAIEfeLDQVfDyWmE0WNLOJA=="}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:02.981445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-3bb960a0-2f52-4ed2-ab1d-0e0e5849c70a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:42:02.985165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-3bb960a0-2f52-4ed2-ab1d-0e0e5849c70a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:42:03.039218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:03.039866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:03.046443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:03.046907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:03.047666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:03.048104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:03.063418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3bb960a0-2f52-4ed2-ab1d-0e0e5849c70a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099380 May 12 20:42:03.064247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 273/586] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:42:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:03.114224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:03.121931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-718e08a5-3734-4a27-8660-a8074074fd93 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1218 microversion: 2.1 time: 0.087280 May 12 20:42:03.122502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 314/587] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:03 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:04.139166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:04.139788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:04.147149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:04.147598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:04.149011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:04.149487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:04.224979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:04.233205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d1eaa4a4-6971-45c0-bcce-343280da4b75 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1266 microversion: 2.1 time: 0.097932 May 12 20:42:04.236559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 274/588] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:04 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:04.517077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:04.517631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:04.524520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:04.524976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:04.525785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:04.526231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:04.671486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid 0fbc0365-6647-411e-9225-26ead37c724d {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:04.980916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-635984bb-0118-423a-b33a-56d625bd7d8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments/41650904-f7f2-4754-9a18-1a0f4fcd2f16" status: 202 len: 0 microversion: 2.1 time: 0.467756 May 12 20:42:04.981496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 315/589] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:42:04 2022] DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments/41650904-f7f2-4754-9a18-1a0f4fcd2f16 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:05.253255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:05.253930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:05.261004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:05.261509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:05.262383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:05.262829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:05.403520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-836984216", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8378bf4-b568-4478-81bf-9948fffba758"}], "security_groups": [{"name": "tempest-securitygroup--627598300"}], "key_name": "tempest-keypair-1239384042", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:05.425138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:05.433919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-18bed567-52bf-4be7-9415-b197a627d33a tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.184605 May 12 20:42:05.435069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 275/590] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:05 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:05.513823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] validate_networks() for [('e8378bf4-b568-4478-81bf-9948fffba758', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:42:05.894700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:42:05.895271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:42:05.895578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:42:05.895983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:42:05.896430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:42:05.905820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:05.906261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:05.907058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:05.907497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:05.924223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:42:05.928111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:42:05.939399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:42:05.942425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:42:06.066951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eff19176-e8b1-4256-b135-863a073695ce tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668657 May 12 20:42:06.074742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 316/591] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:42:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:42:06.079060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-29704643-5ac3-4ecf-ba13-7e3fb38b27c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:06.079682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-29704643-5ac3-4ecf-ba13-7e3fb38b27c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:06.144010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f788fa8e-a7cb-4d86-ab0c-9c012c172c21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:06.153296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f788fa8e-a7cb-4d86-ab0c-9c012c172c21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.153752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f788fa8e-a7cb-4d86-ab0c-9c012c172c21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.172801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-29704643-5ac3-4ecf-ba13-7e3fb38b27c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:06.177055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-29704643-5ac3-4ecf-ba13-7e3fb38b27c6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1241 microversion: 2.1 time: 0.101758 May 12 20:42:06.188543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 276/592] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:06 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:06.198377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f788fa8e-a7cb-4d86-ab0c-9c012c172c21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Going to try to stop instance {{(pid=129358) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 20:42:06.300557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-95f49fa7-482f-45fc-9911-47bb13494020 req-e90bc9f0-bb09-44a7-a286-edecaf5c8c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd31759-99d1-4718-b73b-899a336ebeb3", "tag": "c30ba8f5-c4bf-40bb-993e-52d6b696f858"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:06.312283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-95f49fa7-482f-45fc-9911-47bb13494020 req-e90bc9f0-bb09-44a7-a286-edecaf5c8c65 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.312634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-95f49fa7-482f-45fc-9911-47bb13494020 req-e90bc9f0-bb09-44a7-a286-edecaf5c8c65 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.328416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-95f49fa7-482f-45fc-9911-47bb13494020 req-e90bc9f0-bb09-44a7-a286-edecaf5c8c65 service nova] Creating event network-changed:c30ba8f5-c4bf-40bb-993e-52d6b696f858 for instance 3dd31759-99d1-4718-b73b-899a336ebeb3 on hv-cinder-81565 May 12 20:42:06.333734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-95f49fa7-482f-45fc-9911-47bb13494020 req-e90bc9f0-bb09-44a7-a286-edecaf5c8c65 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037039 May 12 20:42:06.334323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 277/593] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:06.452979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:06.454248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:06.463350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.464116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.465438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f788fa8e-a7cb-4d86-ab0c-9c012c172c21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action" status: 202 len: 0 microversion: 2.1 time: 0.325263 May 12 20:42:06.465816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.469194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 317/594] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:42:06 2022] POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:42:06.469700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.481894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:06.482832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:06.490361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.491031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.492267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:06.493635 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:06.634700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:06.643210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53b94963-7025-41d2-939e-0a41614117f6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.195154 May 12 20:42:06.644107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 278/595] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:06 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:06.657067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:06.664827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-959a65f2-daa8-4a67-9e84-9672abcc3a9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.193756 May 12 20:42:06.665514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 318/596] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:06 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:07.141943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.142755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.149245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.153424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.153424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.153424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.184023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-740bd3e6-83a3-4933-b1a8-1effb9a06e04 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments/dc53161f-d703-4d08-b344-593dd400e8d8" status: 200 len: 194 microversion: 2.20 time: 0.047981 May 12 20:42:07.184617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 279/597] 10.222.0.59 () {60 vars in 1453 bytes} [Thu May 12 20:42:07 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments/dc53161f-d703-4d08-b344-593dd400e8d8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:42:07.195951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.196574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.211700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.212159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.212940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.213416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.256219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.256973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.263488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.263955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.264755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.267054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.281598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:07.289996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-85a18ef7-abb0-4ead-954f-89d458324516 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1245 microversion: 2.1 time: 0.098402 May 12 20:42:07.290568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 319/598] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:07 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:07.359786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lazy-loading 'services' on Instance uuid a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:07.660897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.661459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.669022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.669509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.670278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.670714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.801478 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:07.805157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c2f75c69-1b06-40f5-bdf1-a22245047af9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments/dc53161f-d703-4d08-b344-593dd400e8d8" status: 202 len: 0 microversion: 2.20 time: 0.552495 May 12 20:42:07.805785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 280/599] 10.222.0.59 () {60 vars in 1456 bytes} [Thu May 12 20:42:07 2022] DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments/dc53161f-d703-4d08-b344-593dd400e8d8 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 20:42:07.809734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7ab91455-5dfe-4f0a-9e75-8063e53fda3e tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.152697 May 12 20:42:07.810397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 320/600] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:07 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:07.811232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.812043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.815719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:07.820332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:07.820449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.820449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.820681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.821250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.822934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.823354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.824110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:07.824537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:07.854027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4e7812c6-6c69-4ab8-bfed-1435ec512662 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042582 May 12 20:42:07.854584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 321/601] 10.222.0.59 () {60 vars in 1342 bytes} [Thu May 12 20:42:07 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:42:07.954466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:07.961697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-868ced68-995c-4585-8a08-3edefa4de832 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.154465 May 12 20:42:07.962261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 281/602] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:07 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:08.309377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:08.310006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:08.318360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.318850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.319635 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.320146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.423963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:08.431451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-31b083f3-b802-4b35-aa21-b722969cce36 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1237 microversion: 2.1 time: 0.127880 May 12 20:42:08.432086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 322/603] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:08 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:08.826631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:08.827763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:08.834927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.836287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.837348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.837837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.865939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:08.867542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:08.874956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.875500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.876421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.877131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.935127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c1b5dbaf-e450-4874-a436-6abd648e788b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073320 May 12 20:42:08.939197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 323/604] 10.222.0.59 () {60 vars in 1342 bytes} [Thu May 12 20:42:08 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:42:08.979977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:08.980767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:08.986729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.987187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.987978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:08.988419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:08.993000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:09.000396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4b6b01e9-8ba1-4c4c-87d9-4de446e2af1c tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.177702 May 12 20:42:09.000970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 282/605] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:08 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:09.344425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:09.352725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-71873859-ad55-4b4a-96ba-7dcbd2395dc0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.376671 May 12 20:42:09.353498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 324/606] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:08 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:09.448050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:09.448834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:09.454913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:09.455363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:09.456224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:09.456555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:09.527376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:09.540658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f1e2b05b-dde2-4f90-ae29-327bd84ad04e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1301 microversion: 2.1 time: 0.096555 May 12 20:42:09.541753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 283/607] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:09 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:09.947372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:09.948300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:09.954661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:09.955111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:09.955883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:09.956321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:09.985963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d8a8ee19-7516-42b7-8883-9daf3804377e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043146 May 12 20:42:09.986529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 325/608] 10.222.0.59 () {60 vars in 1342 bytes} [Thu May 12 20:42:09 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:10.018475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:10.024775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:10.032776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.033222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.034249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.034688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.060661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:10.061157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:10.067195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.067651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.068416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.069023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.097340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:10.178997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.187146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cf4082d3-bf39-49f5-9d60-9663cc2e05c3 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.174042 May 12 20:42:10.187716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 284/609] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:10 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:10.356450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b1c688d-2749-443c-8f62-5f64d6ada1ae tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 204 len: 0 microversion: 2.20 time: 0.299281 May 12 20:42:10.360339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 326/610] 10.222.0.59 () {60 vars in 1279 bytes} [Thu May 12 20:42:10 2022] DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 20:42:10.365923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:10.366874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:10.373920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.374484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.375213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:10.375394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.376041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.381524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:10.387969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.388418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.389420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.390110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.527456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.535515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.537014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.538217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dbba66c2-e04c-4a28-80ae-6b6b39a84b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.176463 May 12 20:42:10.541331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 285/611] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:10 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:10.563117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:10.563727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:10.569714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.570516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.571306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:10.571740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:10.572776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.580152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4682f930-0f59-4bf2-b2d0-c211cd69979d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.213177 May 12 20:42:10.580986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 327/612] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:10 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:10.710197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:10.717502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-836a1756-5ef3-4e0a-b8f6-30392f0dc5a8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.158225 May 12 20:42:10.718142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 286/613] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:10 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:10.992588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-3434b15e-b587-4026-970c-0a0a89c4338d req-58511a9e-f365-4971-92d7-c0b434435252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd31759-99d1-4718-b73b-899a336ebeb3", "name": "network-vif-plugged", "status": "completed", "tag": "c30ba8f5-c4bf-40bb-993e-52d6b696f858"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:11.000892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3434b15e-b587-4026-970c-0a0a89c4338d req-58511a9e-f365-4971-92d7-c0b434435252 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.006677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3434b15e-b587-4026-970c-0a0a89c4338d req-58511a9e-f365-4971-92d7-c0b434435252 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.013521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-3434b15e-b587-4026-970c-0a0a89c4338d req-58511a9e-f365-4971-92d7-c0b434435252 service nova] Creating event network-vif-plugged:c30ba8f5-c4bf-40bb-993e-52d6b696f858 for instance 3dd31759-99d1-4718-b73b-899a336ebeb3 on hv-cinder-81565 May 12 20:42:11.018258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-3434b15e-b587-4026-970c-0a0a89c4338d req-58511a9e-f365-4971-92d7-c0b434435252 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030004 May 12 20:42:11.018858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 328/614] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:11.203962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:11.204660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:11.211992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.212375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.213167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.213625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.338777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.346125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-17d6b6ca-6eac-4fa8-aae6-91bbc6b58245 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.146076 May 12 20:42:11.346690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 287/615] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:11 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:11.558261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:11.558915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:11.565115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.565632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.566404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.566844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.598352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:11.598968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:11.605176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.605663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.606428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.606861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.693072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.701712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.703223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.704381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cc9ff57f-9fcc-4549-b6e7-5fb448ff6a98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.150524 May 12 20:42:11.704942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 329/616] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:11 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:11.735444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:11.735860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:11.738230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.741916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.742741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.743518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:11.743958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:11.745661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6369e806-5910-4843-80a9-3874f390fc27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.151003 May 12 20:42:11.746254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 288/617] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:11 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:11.872755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:11.880277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6b73d293-6649-4210-b4dd-bb6afb9e23ff tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.148492 May 12 20:42:11.880826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 330/618] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:11 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:12.363688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:12.364410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:12.372249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.373218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.373634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.374075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.723446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:12.728086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:12.733328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.734152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.735313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.735977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.791084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:12.799833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d6122940-29f9-4acf-8386-7dd280d40763 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.440364 May 12 20:42:12.800775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 289/619] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:12 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:12.806666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-7e9825d7-3011-4dc6-8d28-f11537ba9ea0 req-bd27aea0-6986-4a9f-9995-13edfc507fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e51169-24f1-4938-b088-951b5795a799", "tag": "352714e9-fe37-4972-95f9-59c76534d0ab"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:12.815177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-7e9825d7-3011-4dc6-8d28-f11537ba9ea0 req-bd27aea0-6986-4a9f-9995-13edfc507fa3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.815981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-7e9825d7-3011-4dc6-8d28-f11537ba9ea0 req-bd27aea0-6986-4a9f-9995-13edfc507fa3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.830600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-7e9825d7-3011-4dc6-8d28-f11537ba9ea0 req-bd27aea0-6986-4a9f-9995-13edfc507fa3 service nova] Creating event network-changed:352714e9-fe37-4972-95f9-59c76534d0ab for instance 31e51169-24f1-4938-b088-951b5795a799 on hv-cinder-81565 May 12 20:42:12.837309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-7e9825d7-3011-4dc6-8d28-f11537ba9ea0 req-bd27aea0-6986-4a9f-9995-13edfc507fa3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 May 12 20:42:12.837976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 290/620] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:12.843421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:12.844319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:12.850804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.851544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.852350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.853479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.930788 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:12.940365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:12.942221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:12.944352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cb890047-32b6-4d06-a6b4-3a21bf7d9b23 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1724 microversion: 2.20 time: 0.224215 May 12 20:42:12.964793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 331/621] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:12 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:42:12.973539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:12.974170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:12.981217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.981778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:12.982562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:12.983006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:13.126107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:13.134960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-559d18e8-62de-48f0-a215-a7bc97a864fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.295569 May 12 20:42:13.135904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 291/622] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:12 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:13.248222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:13.255725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d2fb302-0a3c-46ea-b20b-c5fdd9f6690f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.289023 May 12 20:42:13.256295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 332/623] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:12 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:13.648823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-f6c99e70-4c8a-47d6-b8b5-8794b70a8277 req-7d1b9b21-6b7d-44f8-a6b1-e83b0112474e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90", "name": "network-vif-deleted", "tag": "eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:13.657123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f6c99e70-4c8a-47d6-b8b5-8794b70a8277 req-7d1b9b21-6b7d-44f8-a6b1-e83b0112474e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:13.657589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f6c99e70-4c8a-47d6-b8b5-8794b70a8277 req-7d1b9b21-6b7d-44f8-a6b1-e83b0112474e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:13.669560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-f6c99e70-4c8a-47d6-b8b5-8794b70a8277 req-7d1b9b21-6b7d-44f8-a6b1-e83b0112474e service nova] Creating event network-vif-deleted:eb6ed7bc-3adb-4e44-a9ab-8a8f0482c777 for instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 on hv-cinder-81565 May 12 20:42:13.675183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-f6c99e70-4c8a-47d6-b8b5-8794b70a8277 req-7d1b9b21-6b7d-44f8-a6b1-e83b0112474e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030220 May 12 20:42:13.676074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 292/624] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:13.818155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:13.822814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:13.826399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:13.827066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:13.827880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:13.828312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:13.965781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:13.972843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:13.973208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7450d710-759a-4e94-a305-60faf47f4a5b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1314 microversion: 2.1 time: 0.158966 May 12 20:42:13.973797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 333/625] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:13 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:13.974365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:13.982909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:13.987607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:13.987607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:13.987607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.059198 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:14.067218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:14.068860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:14.070250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f7186542-ea51-4fa4-8522-811ca21562c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1366 microversion: 2.20 time: 0.101986 May 12 20:42:14.070827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 293/626] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:13 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:14.152494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:14.153414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:14.159538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.159992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.160851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.161219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.275818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:14.276550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:14.283455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.284033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.285016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.285594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.325143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:14.333135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a04236e5-2eec-48a4-93b2-520b15740222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.184991 May 12 20:42:14.336496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 334/627] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:14 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:14.501006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:14.509332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-db7cccd2-8d12-4f85-b9b3-fa49b8ab2643 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.239421 May 12 20:42:14.510234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 294/628] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:14 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:14.990126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:14.990824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:14.997660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.998113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:14.998880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:14.999319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.088143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:15.088845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:15.095542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.096077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.096946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.097491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.129544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.130271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.130721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lazy-loading 'fault' on Instance uuid a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:15.134962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.142329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-40b078e1-ea07-4ef7-8b86-a54621edb5aa tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1464 microversion: 2.1 time: 0.156025 May 12 20:42:15.142898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 335/629] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:14 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:15.172821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.181245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.181673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:15.182166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:15.182807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.183958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eb95bc69-54cd-442c-a58b-2075fc0961ab tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 200 len: 1371 microversion: 2.20 time: 0.099854 May 12 20:42:15.184510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 295/630] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:15 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:42:15.188166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.188610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.189389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.189822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.214443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:15.357239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:15.357902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:15.363954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.364368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.365144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.365624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.476277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-18104e87-12ca-44fd-93f4-152c2321a43d tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 204 len: 0 microversion: 2.1 time: 0.298668 May 12 20:42:15.480182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 336/631] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:42:15 2022] DELETE /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 20:42:15.485435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:15.486149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:15.492762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.493211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.494027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.494468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.505626 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.513303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1c5f65d2-75dd-4b81-9d63-dd71c5f0e533 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.159848 May 12 20:42:15.513882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 296/632] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:15 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:15.525874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:15.526493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:15.532428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.532881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.533709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:15.534184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:15.623731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.631369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e4d287c1-af02-4fa1-ac84-dff8450b40fb tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1470 microversion: 2.1 time: 0.150167 May 12 20:42:15.631936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 337/633] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:15 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:15.670134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:15.677492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8c9b69d7-15c4-4143-bd7e-6708ee938fee tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.155352 May 12 20:42:15.678056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 297/634] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:15 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:16.201375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:16.202052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:16.208283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.208742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.209535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.210009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.224123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 HTTP/1.1 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:42:16.226327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 20:42:16.227978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': 'a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90'} May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:16.229123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 20:42:16.230643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:16.232059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:16.232059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-19bbb3c7-d0a3-42a7-967a-ffaa23e3ba6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 404 len: 111 microversion: 2.20 time: 0.030258 May 12 20:42:16.232059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 338/635] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:16 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:42:16.236729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d0ebe90b-1c2e-40cd-aa8e-e0b13be021d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '.version_select at 0x7f4e62e54940>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:16.303119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d0ebe90b-1c2e-40cd-aa8e-e0b13be021d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611159299" status: 204 len: 0 microversion: 2.20 time: 0.070189 May 12 20:42:16.303682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 298/636] 10.222.0.59 () {60 vars in 1261 bytes} [Thu May 12 20:42:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611159299 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 20:42:16.532753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:16.532753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:16.538229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.539901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.541363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.541916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.650675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:16.651617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:16.657764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.658424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.659366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.659972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.678251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:16.687189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fe27a076-ef37-4b16-8a1d-36d6295a2d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1679 microversion: 2.1 time: 0.159736 May 12 20:42:16.687764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 339/637] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:16 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:16.694499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:16.695790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:16.702012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.702467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.703254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:16.703682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:16.835800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:16.843323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fbd98e61-1828-4adc-9726-83c9364cf5b7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.152377 May 12 20:42:16.843901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 340/638] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:16 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:16.875479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:16.883211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4a8b17f-abc2-4b10-b676-e7cb2d2c087b tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1470 microversion: 2.1 time: 0.237176 May 12 20:42:16.883947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 299/639] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:16 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:17.174019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-18a8aaf0-17b2-43c0-b4f5-beb686cdf8de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: .version_select at 0x7f4e62d85040>, body: {"keypair": {"name": "tempest-keypair-233400354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgJ1TtGP6Q0meJTh+ddJcAgiW+2WLEo/fRKBSLqNFc+cczmIrX83aK+fUEccyE5Gn9zvi45A0jzGRWZb1r1wGSn3IZDeN/UorOkc/7JJkGH9dl+OVIxsLk6vV8nLQDiiA=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:17.187660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-18a8aaf0-17b2-43c0-b4f5-beb686cdf8de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for project e3bcc803e53f46efb996577417eca77a. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:42:17.191347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-18a8aaf0-17b2-43c0-b4f5-beb686cdf8de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for user 64ce721d7163430dbf31ffbbf28c2094 and project e3bcc803e53f46efb996577417eca77a. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:42:17.285876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-18a8aaf0-17b2-43c0-b4f5-beb686cdf8de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.115723 May 12 20:42:17.286564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 341/640] 10.222.0.59 () {62 vars in 1199 bytes} [Thu May 12 20:42:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 20:42:17.706344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:17.706955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:17.714718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:17.715168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:17.715932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:17.716366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:17.858782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:17.861428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:17.862312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:17.870404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:17.871119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:17.872228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:17.872885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:17.875886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e64b2be8-2635-4949-a7e8-c3d12fd915e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1656 microversion: 2.1 time: 0.173356 May 12 20:42:17.877614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 300/641] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:17 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:17.894291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-20111dc9-9931-4162-a817-5ee6e64fa867 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:17.902263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20111dc9-9931-4162-a817-5ee6e64fa867 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:17.902993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20111dc9-9931-4162-a817-5ee6e64fa867 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:17.928222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-20111dc9-9931-4162-a817-5ee6e64fa867 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Going to try to start instance {{(pid=129357) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 20:42:18.018580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:18.026649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b62324cb-d738-4c1f-b995-6fc44d4da255 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.170559 May 12 20:42:18.027222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 342/642] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:17 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:18.031868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:18.032476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:18.039067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:18.039522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:18.040443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:18.040883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:18.133510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-20111dc9-9931-4162-a817-5ee6e64fa867 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action" status: 202 len: 0 microversion: 2.1 time: 0.242415 May 12 20:42:18.134620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 301/643] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:42:17 2022] POST /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:18.146535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:18.165546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:18.166746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:18.172124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c65e76b7-0da1-4b7c-9fb1-f6b727b7ccd8 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1428 microversion: 2.1 time: 0.143388 May 12 20:42:18.173628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 343/644] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:18 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:18.178613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:18.181449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:18.181449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:18.181449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:18.213757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-63f318e7-09d7-4eb0-9559-38be4f1ebae8 req-e05933b0-7939-4358-9f55-6913c7452a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd31759-99d1-4718-b73b-899a336ebeb3", "name": "network-vif-deleted", "tag": "c30ba8f5-c4bf-40bb-993e-52d6b696f858"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:18.229555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-63f318e7-09d7-4eb0-9559-38be4f1ebae8 req-e05933b0-7939-4358-9f55-6913c7452a77 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:18.230714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-63f318e7-09d7-4eb0-9559-38be4f1ebae8 req-e05933b0-7939-4358-9f55-6913c7452a77 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:18.277329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-63f318e7-09d7-4eb0-9559-38be4f1ebae8 req-e05933b0-7939-4358-9f55-6913c7452a77 service nova] Creating event network-vif-deleted:c30ba8f5-c4bf-40bb-993e-52d6b696f858 for instance 3dd31759-99d1-4718-b73b-899a336ebeb3 on hv-cinder-81565 May 12 20:42:18.283629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-63f318e7-09d7-4eb0-9559-38be4f1ebae8 req-e05933b0-7939-4358-9f55-6913c7452a77 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074040 May 12 20:42:18.284343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 344/645] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:18.395815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:18.405084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-87bf6e8e-4b13-41bd-8e84-e2e262f66126 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1665 microversion: 2.1 time: 0.264264 May 12 20:42:18.405922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 302/646] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:18 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1665 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:19.044929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:19.045771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:19.052508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.055511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.055511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.055511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.190137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:19.190687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:19.197718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.198183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.198955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.199591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.237193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.238028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.238683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lazy-loading 'fault' on Instance uuid 3dd31759-99d1-4718-b73b-899a336ebeb3 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:19.312047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9740039be9644eb58b3a12eb021e287d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2494c982e7f45cba3b28a0ccdf3a83f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:19.320472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-523909d3-c188-4c5c-9f22-f8a5302da1d6 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 200 len: 1304 microversion: 2.1 time: 0.134201 May 12 20:42:19.321514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 303/647] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:19 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:19.424150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:19.424892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:19.431715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.435016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.436523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:19.437354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:19.472506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:19.479985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7958e9b0-77dd-4e73-b68e-b8327d7c93fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.439699 May 12 20:42:19.485646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 345/648] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:19 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:19.678407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:19.685906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d6144293-9369-4896-9d09-91d80fe440ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1665 microversion: 2.1 time: 0.265769 May 12 20:42:19.686474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 304/649] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:19 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1665 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:20.030902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1708230015", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa5bcf78-e33b-4c87-a2bb-4b70380d365f"}], "security_groups": [{"name": "tempest-securitygroup--2055647136"}], "key_name": "tempest-keypair-233400354", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:20.128984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] validate_networks() for [('aa5bcf78-e33b-4c87-a2bb-4b70380d365f', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:42:20.344003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:20.344615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] [instance: 3dd31759-99d1-4718-b73b-899a336ebeb3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:20.350865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.351310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.352275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.352711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.367765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] HTTP exception thrown: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Request method failure captured: May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 HTTP/1.1 May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXEX82saud6AlTLGJp5jSvG746XfmzyoLgk62X1bwPcGOhGCPSETl9sX8EPodRR0tRQFBCnTuuRxxOFfAfyT41khc6FhFOEYHsLwP_2l5_KdEEVElWZvhRY7FHSe2VvCqp7HCjT9g71OWuMp--z-UhfX5oRvC7nF14oZpT_1nkX4UiU May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: b2494c982e7f45cba3b28a0ccdf3a83f May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesNegativeTest-759444895 May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:42:20.369683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b2494c982e7f45cba3b28a0ccdf3a83f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b2494c982e7f45cba3b28a0ccdf3a83f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b2494c982e7f45cba3b28a0ccdf3a83f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b2494c982e7f45cba3b28a0ccdf3a83f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesNegativeTest-759444895 May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: b2494c982e7f45cba3b28a0ccdf3a83f May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesNegativeTest-759444895 May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesNegativeTest-759444895-project May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 9740039be9644eb58b3a12eb021e287d May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesNegativeTest-759444895-project May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. May 12 20:42:20.371148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '3dd31759-99d1-4718-b73b-899a336ebeb3'} May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:20.372049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. May 12 20:42:20.373424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:20.374568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] Returning 404 to user: Instance 3dd31759-99d1-4718-b73b-899a336ebeb3 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:20.374568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a6a871c0-fdae-478a-be00-cb9c54ee3735 tempest-VolumesNegativeTest-759444895 tempest-VolumesNegativeTest-759444895-project] 10.222.0.59 "GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3" status: 404 len: 111 microversion: 2.1 time: 0.031068 May 12 20:42:20.374568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 305/650] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:20 2022] GET /compute/v2.1/servers/3dd31759-99d1-4718-b73b-899a336ebeb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 20:42:20.495775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:42:20.496249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:42:20.496748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:42:20.497152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:42:20.497595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:42:20.498502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:20.499182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:20.507037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.507955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.508894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.509361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.512659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.513114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.513951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.514386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.531882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for project e3bcc803e53f46efb996577417eca77a. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:42:20.536146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Getting quotas for user 64ce721d7163430dbf31ffbbf28c2094 and project e3bcc803e53f46efb996577417eca77a. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:42:20.557423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:42:20.561237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:42:20.652194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:20.660345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2c588a53-ac34-495e-a895-fec426801395 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.166289 May 12 20:42:20.660979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 306/651] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:20 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:20.676474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-24888293-1798-4e5b-a14a-a194a3ef6da2 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.649930 May 12 20:42:20.677153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 346/652] 10.222.0.59 () {62 vars in 1187 bytes} [Thu May 12 20:42:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 12 20:42:20.693182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:20.698823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:20.702483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:20.703093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:20.712512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.713171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.714126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:20.714713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:20.764527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:20.772011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:20.774333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:20.775587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a94f7608-eefa-4094-9c9c-288247b86e44 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1281 microversion: 2.20 time: 0.086687 May 12 20:42:20.776149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 307/653] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:20 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:42:20.875687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:20.884500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d1634db-7e65-45a3-be53-ea7c9df906fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1669 microversion: 2.1 time: 0.186015 May 12 20:42:20.885065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 347/654] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:20 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1669 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:21.058107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-5a22c5e5-ab23-4a3d-87dc-77eb6dee1787 req-a99fb8be-db0f-4260-a036-7291113268e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e51169-24f1-4938-b088-951b5795a799", "name": "network-vif-plugged", "status": "completed", "tag": "352714e9-fe37-4972-95f9-59c76534d0ab"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:21.066164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5a22c5e5-ab23-4a3d-87dc-77eb6dee1787 req-a99fb8be-db0f-4260-a036-7291113268e0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:21.066606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5a22c5e5-ab23-4a3d-87dc-77eb6dee1787 req-a99fb8be-db0f-4260-a036-7291113268e0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:21.078172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-5a22c5e5-ab23-4a3d-87dc-77eb6dee1787 req-a99fb8be-db0f-4260-a036-7291113268e0 service nova] Creating event network-vif-plugged:352714e9-fe37-4972-95f9-59c76534d0ab for instance 31e51169-24f1-4938-b088-951b5795a799 on hv-cinder-81565 May 12 20:42:21.083324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-5a22c5e5-ab23-4a3d-87dc-77eb6dee1787 req-a99fb8be-db0f-4260-a036-7291113268e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029645 May 12 20:42:21.083902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 308/655] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:21.677489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:21.678104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:21.685100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:21.685583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:21.686634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:21.687072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:21.797501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:21.798506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:21.809201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:21.809201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:21.809201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:21.809201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:21.825539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:21.833967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a68398f3-3466-427b-97b4-a58a5ad6b932 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.160434 May 12 20:42:21.834822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 348/656] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:21 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:21.877119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:21.895424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:21.895424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:21.895424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1d7ee0f5-23ba-46fe-83e5-586f1cf7dc6d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1285 microversion: 2.20 time: 0.096665 May 12 20:42:21.895825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 309/657] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:21 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:42:22.851941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:22.853134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:22.859528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:22.859989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:22.860765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:22.861202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:22.907013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:22.907876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:22.914220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:22.915187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:22.915957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:22.916398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:22.981465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:22.989658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:22.991208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:22.992600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a7076ee0-5fb4-4fee-afe1-17b1c7b39edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1333 microversion: 2.20 time: 0.089540 May 12 20:42:22.994669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 310/658] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:22 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:42:23.004290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:23.012502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ca1887f0-c1da-4c9f-9fa2-d676beeb6124 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1366 microversion: 2.1 time: 0.164318 May 12 20:42:23.013594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 349/659] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:22 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:24.016072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:24.016072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:24.022958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.023618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.025503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.025944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.030363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:24.031438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:24.038755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.039134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.040588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.041122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.115147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:24.123901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:24.125515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:24.126629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d93438ea-a04c-4016-b24f-73aec5e71b94 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1339 microversion: 2.20 time: 0.116874 May 12 20:42:24.127190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 311/660] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:24 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:24.236574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:24.237216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:24.244133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.244586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.245408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.246217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.271198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:24.282100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3009cce0-2108-4475-af61-da19e803eef4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1556 microversion: 2.1 time: 0.256014 May 12 20:42:24.283076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 350/661] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:24 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:24.300142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:24.300780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:24.314497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.315231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.316364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.316969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.346785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'services' on Instance uuid ac1f7b3f-92ec-4533-872e-e7886f43d138 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:24.448409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d038e179-c1b8-4a77-bacf-f0747a4aa410 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152290 May 12 20:42:24.449085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 351/662] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:42:24 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:42:24.572920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fcc0c30c-08e7-4849-a761-eb27ea9fe77c tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments/09e5a10b-da02-4d6f-8a30-8696e9d1b798" status: 202 len: 0 microversion: 2.1 time: 0.340225 May 12 20:42:24.573641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 312/663] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:42:24 2022] DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments/09e5a10b-da02-4d6f-8a30-8696e9d1b798 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:42:24.582332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:24.583323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:24.590011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.590469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.591253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:24.595238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:24.624414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d5b296fa-331f-4535-816c-a8b693a6f48f tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 May 12 20:42:24.625106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 352/664] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:24 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:25.145973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:25.146876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:25.154075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:25.154779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:25.155556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:25.156224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:25.365518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:25.374819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:25.380554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:25.384001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4af24f48-ff95-47ce-8502-a5b15d277b6e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.240935 May 12 20:42:25.384001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 313/665] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:25 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:25.637245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:25.638465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:25.645048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:25.651269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:25.651269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:25.651269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:25.683440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-071bfb07-a82a-4ae2-bfa2-ac70122643dd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050890 May 12 20:42:25.684235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 353/666] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:25 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:25.954780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-784b3fca-e80a-4a34-b78f-40c4894e153d req-d86ff321-f2e3-44da-bb76-006be131c586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e51169-24f1-4938-b088-951b5795a799", "tag": "352714e9-fe37-4972-95f9-59c76534d0ab"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:25.964631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-784b3fca-e80a-4a34-b78f-40c4894e153d req-d86ff321-f2e3-44da-bb76-006be131c586 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:25.965138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-784b3fca-e80a-4a34-b78f-40c4894e153d req-d86ff321-f2e3-44da-bb76-006be131c586 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:25.976511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-784b3fca-e80a-4a34-b78f-40c4894e153d req-d86ff321-f2e3-44da-bb76-006be131c586 service nova] Creating event network-changed:352714e9-fe37-4972-95f9-59c76534d0ab for instance 31e51169-24f1-4938-b088-951b5795a799 on hv-cinder-81565 May 12 20:42:25.982680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-784b3fca-e80a-4a34-b78f-40c4894e153d req-d86ff321-f2e3-44da-bb76-006be131c586 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 May 12 20:42:25.983221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 314/667] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:26.091012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-fbc08f9f-75bf-48b8-ad47-08665c6aa74f req-8edddc23-154d-4930-856b-348cc44ef80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:26.103664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-fbc08f9f-75bf-48b8-ad47-08665c6aa74f req-8edddc23-154d-4930-856b-348cc44ef80a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.104110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-fbc08f9f-75bf-48b8-ad47-08665c6aa74f req-8edddc23-154d-4930-856b-348cc44ef80a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.116296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-fbc08f9f-75bf-48b8-ad47-08665c6aa74f req-8edddc23-154d-4930-856b-348cc44ef80a service nova] Creating event network-changed:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:42:26.122119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-fbc08f9f-75bf-48b8-ad47-08665c6aa74f req-8edddc23-154d-4930-856b-348cc44ef80a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035585 May 12 20:42:26.123625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 354/668] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:26.405743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:26.405743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:26.411904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.412494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.413620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.414459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.671786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:26.681355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:26.683329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:26.684698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3fb13d49-a2ac-40c8-b34b-0c7e5e2afac5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.287086 May 12 20:42:26.696887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 315/669] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:26 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:26.701265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:26.702499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:26.712211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.712914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.713885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.714499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.750223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c45c5a99-ed26-4f22-8e18-3bf2759097ee tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056879 May 12 20:42:26.756226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 355/670] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:26 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:42:26.843751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:26.844245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:26.855009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.856045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.857255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:26.857954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:26.895605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:27.167385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7533e6ef-504c-4f24-be01-206f9fe343b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 204 len: 0 microversion: 2.1 time: 0.327583 May 12 20:42:27.168147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 316/671] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:42:26 2022] DELETE /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:42:27.176007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:27.176618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:27.183438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:27.183713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:27.184491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:27.184935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:27.331972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:27.339349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc9447e7-5598-446c-a8b1-f27b93dab0a5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1688 microversion: 2.1 time: 0.167327 May 12 20:42:27.344345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 356/672] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:27 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:27.703285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:27.703904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:27.710365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:27.710825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:27.712341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:27.712865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:27.843084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:27.851231 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:27.853364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:27.854482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0dac83e5-6d21-46e6-a59d-f38fb7d18543 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.155606 May 12 20:42:27.855042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 317/673] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:27 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:28.356805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:28.357469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:28.363744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:28.364194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:28.364948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:28.365416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:28.503071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:28.511310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d7ccc6f8-d781-4e7f-acf1-26104a4c457d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1688 microversion: 2.1 time: 0.158403 May 12 20:42:28.511881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 357/674] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:28 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:28.873688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:28.874298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:28.880824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:28.881288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:28.882055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:28.882487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:29.013801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:29.021750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:29.023355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:29.025117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-36488dc4-fdd0-4ae3-9b2b-17356cad846e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.155674 May 12 20:42:29.025724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 318/675] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:28 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:29.528214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:29.528728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:29.535162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:29.535610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:29.536375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:29.536814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:29.663573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:29.671571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-274200b8-c8f9-4eb5-b96c-9aafe01e58cb tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1688 microversion: 2.1 time: 0.147405 May 12 20:42:29.672137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 358/676] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:29 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:30.043868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:30.044530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:30.051561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:30.052006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:30.052779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:30.053216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:30.194438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:30.202757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:30.204251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:30.205447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8b636824-b2dc-421b-89ff-df3a73e287cc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.166350 May 12 20:42:30.206005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 319/677] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:30 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:30.689200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:30.689821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:30.699462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:30.699462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:30.699462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:30.699462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:30.826937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:30.834371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-143c58e6-2a3e-4c82-9ca3-c6f4806864bf tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1688 microversion: 2.1 time: 0.149225 May 12 20:42:30.834942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 359/678] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:30 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:31.224075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:31.224616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:31.231529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:31.231986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:31.232752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:31.233197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:31.365859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:31.375122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:31.376624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:31.377763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-77c70470-cd94-4bad-b2ed-a154a35922bd tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.157695 May 12 20:42:31.378314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 320/679] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:31 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:31.851193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:31.852473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:31.859290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:31.859743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:31.860509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:31.860942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:32.130970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:32.138596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ebf2465e-61bc-4341-8379-e306fd39afbd tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1688 microversion: 2.1 time: 0.291206 May 12 20:42:32.139174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 360/680] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:31 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:32.396188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:32.396834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:32.403910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:32.404361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:32.405121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:32.405640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:32.535117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:32.542945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:32.544432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:32.545676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-be908e93-895e-4394-b928-a9362fe48203 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.153587 May 12 20:42:32.546229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 321/681] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:32 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:32.651254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-e277ac02-d6a7-4c33-affe-1a18f7cf9ac1 req-e9d04c07-6a8a-4ba5-be02-2e0c407e6212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1f7b3f-92ec-4533-872e-e7886f43d138", "name": "network-vif-deleted", "tag": "3a32284f-e70e-4e1c-8a76-95040a95a6cf"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:32.659136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e277ac02-d6a7-4c33-affe-1a18f7cf9ac1 req-e9d04c07-6a8a-4ba5-be02-2e0c407e6212 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:32.659848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-e277ac02-d6a7-4c33-affe-1a18f7cf9ac1 req-e9d04c07-6a8a-4ba5-be02-2e0c407e6212 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:32.671263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-e277ac02-d6a7-4c33-affe-1a18f7cf9ac1 req-e9d04c07-6a8a-4ba5-be02-2e0c407e6212 service nova] Creating event network-vif-deleted:3a32284f-e70e-4e1c-8a76-95040a95a6cf for instance ac1f7b3f-92ec-4533-872e-e7886f43d138 on hv-cinder-81565 May 12 20:42:32.676271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-e277ac02-d6a7-4c33-affe-1a18f7cf9ac1 req-e9d04c07-6a8a-4ba5-be02-2e0c407e6212 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029535 May 12 20:42:32.676962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 361/682] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:33.156020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:33.156662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:33.162499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.162944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.163701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.164179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.196658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.197192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.197700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'fault' on Instance uuid ac1f7b3f-92ec-4533-872e-e7886f43d138 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:33.235427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-5fd984ff-d9b1-4785-a4d5-3605217f92df req-66dc25d0-df02-49d2-af7c-6c9f0b29ef53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "name": "network-vif-plugged", "status": "completed", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:33.244292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:33.245753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5fd984ff-d9b1-4785-a4d5-3605217f92df req-66dc25d0-df02-49d2-af7c-6c9f0b29ef53 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.246262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5fd984ff-d9b1-4785-a4d5-3605217f92df req-66dc25d0-df02-49d2-af7c-6c9f0b29ef53 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.252696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70eb13c1-88c1-4d96-a4c9-3d0584b85ed8 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 200 len: 1333 microversion: 2.1 time: 0.100707 May 12 20:42:33.262810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 322/683] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:33 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:33.263005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-5fd984ff-d9b1-4785-a4d5-3605217f92df req-66dc25d0-df02-49d2-af7c-6c9f0b29ef53 service nova] Creating event network-vif-plugged:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:42:33.263898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-5fd984ff-d9b1-4785-a4d5-3605217f92df req-66dc25d0-df02-49d2-af7c-6c9f0b29ef53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032584 May 12 20:42:33.264637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 362/684] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:42:33.563406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:33.564006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:33.571357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.571811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.572591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:33.573217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:33.723511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:33.732265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:33.733801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:33.734915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d455a573-8fcf-4115-93a0-b78b1877d10f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.175591 May 12 20:42:33.735469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 323/685] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:33 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:34.270831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:34.271529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: ac1f7b3f-92ec-4533-872e-e7886f43d138] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:34.278774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:34.279235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:34.280039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:34.280483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:34.294122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] HTTP exception thrown: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Request method failure captured: May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 HTTP/1.1 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz1nlroBCS0z9CAFGhOAWRaQrvgY3sdBRyvmLUWpqZRCr4DZ6SqTkMaldH6lEflE8tNJvN1W1-kIe50dc6LkQB5FPvsJXGfRn5qbZZoiBz9xG66YcTprXNYFPtttmGCcDp8kjNkb4tAvIbUatUy3rwt0HG1EU_iza49vMuuHTKSQw May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:42:34.295745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_500b58188f1a4a088b52b67eb5772984", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 2a2b95ccb7804311a011f37ccb371771 May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. May 12 20:42:34.297390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': 'ac1f7b3f-92ec-4533-872e-e7886f43d138'} May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:34.298431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. May 12 20:42:34.299779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:34.301227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Returning 404 to user: Instance ac1f7b3f-92ec-4533-872e-e7886f43d138 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:34.301227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-83b9b0c4-a955-4a7b-be40-41332c4ced68 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138" status: 404 len: 111 microversion: 2.1 time: 0.030625 May 12 20:42:34.301227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 363/686] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:34 2022] GET /compute/v2.1/servers/ac1f7b3f-92ec-4533-872e-e7886f43d138 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:34.306362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1ddb0b45-792e-4f00-b143-544d745ab7e6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '.version_select at 0x7f4e62ea6b80>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:34.378820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1ddb0b45-792e-4f00-b143-544d745ab7e6 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470728356" status: 202 len: 0 microversion: 2.1 time: 0.076834 May 12 20:42:34.379383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 324/687] 10.222.0.59 () {58 vars in 1217 bytes} [Thu May 12 20:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470728356 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:34.754048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:34.754587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:34.761776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:34.762231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:34.763005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:34.763435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:35.149757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:35.157620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:35.159307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:35.160416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-42544109-b776-4379-8b07-72822ff9a2ec tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1407 microversion: 2.20 time: 0.410467 May 12 20:42:35.160971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 364/688] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:34 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:36.178462 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:36.179085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:36.185342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:36.185826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:36.186601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:36.187043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:36.317549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:36.326107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:36.327607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:36.328760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3ca44d9d-9290-4cbc-a022-c5a5e49fde21 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1599 microversion: 2.20 time: 0.154728 May 12 20:42:36.329427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 325/689] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:42:36 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:42:36.358504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:36.359015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:36.365435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:36.365891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:36.366660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:36.367103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:36.443666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6cccb8ab-86aa-4f21-b431-146bd9dad248 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088996 May 12 20:42:36.444262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 365/690] 10.222.0.59 () {60 vars in 1315 bytes} [Thu May 12 20:42:36 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:42:37.518683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-064f804f-d67b-49d7-b163-bfebfc0b9e41 req-86e83c49-c783-4e4a-9d2c-c28fdc4b7b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:37.528081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-064f804f-d67b-49d7-b163-bfebfc0b9e41 req-86e83c49-c783-4e4a-9d2c-c28fdc4b7b48 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:37.528607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-064f804f-d67b-49d7-b163-bfebfc0b9e41 req-86e83c49-c783-4e4a-9d2c-c28fdc4b7b48 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:37.540591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-064f804f-d67b-49d7-b163-bfebfc0b9e41 req-86e83c49-c783-4e4a-9d2c-c28fdc4b7b48 service nova] Creating event network-changed:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:42:37.545633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-064f804f-d67b-49d7-b163-bfebfc0b9e41 req-86e83c49-c783-4e4a-9d2c-c28fdc4b7b48 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030649 May 12 20:42:37.546416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 326/691] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:38.165094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:38.165094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:38.165094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:38.165094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:38.166743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:38.166743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:38.166743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:38.485018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7d140ed4-58db-483d-a85f-16059e491e1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 204 len: 0 microversion: 2.1 time: 0.386705 May 12 20:42:38.488661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 366/692] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:42:38 2022] DELETE /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 20:42:38.495375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:38.496080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:38.502559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:38.503009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:38.503782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:38.504212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:38.637976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:38.645429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a1ed6fd1-5121-4052-a1ff-7876c9a619b5 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1508 microversion: 2.1 time: 0.155007 May 12 20:42:38.646060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 327/693] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:38 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:39.664387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:39.665506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:39.671867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:39.672311 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:39.673068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:39.673527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:39.800329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:39.808638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3281d822-1830-4637-a68a-9c23cf877cac tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1508 microversion: 2.1 time: 0.148606 May 12 20:42:39.809190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 367/694] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:39 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:40.826604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:40.827314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:40.833645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:40.834098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:40.834854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:40.835284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:40.970115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:40.978358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-88dee0f0-40c7-4653-9ebb-a279eda6a712 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1508 microversion: 2.1 time: 0.154794 May 12 20:42:40.979346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 328/695] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:40 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:41.462722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-486459844"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:41.463285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:41.469797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:41.470254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:41.471033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:41.471487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:41.642848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.network.security_group_api [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Removing security group 89e868b7-3795-4b56-b001-5ec54aa8c979 from port 57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 May 12 20:42:41.868540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-66b6ce66-c38f-4151-b356-f0efcc7f4fdd req-8947f6f7-e3ad-4e41-b9c9-4a91a8554049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac2486e-2cc0-43d2-b384-4249cab22a41", "name": "network-vif-deleted", "tag": "1ac9c000-2052-4024-bbe2-b690193142dd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:41.877218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-66b6ce66-c38f-4151-b356-f0efcc7f4fdd req-8947f6f7-e3ad-4e41-b9c9-4a91a8554049 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:41.878703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-66b6ce66-c38f-4151-b356-f0efcc7f4fdd req-8947f6f7-e3ad-4e41-b9c9-4a91a8554049 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:41.888632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-66b6ce66-c38f-4151-b356-f0efcc7f4fdd req-8947f6f7-e3ad-4e41-b9c9-4a91a8554049 service nova] Creating event network-vif-deleted:1ac9c000-2052-4024-bbe2-b690193142dd for instance eac2486e-2cc0-43d2-b384-4249cab22a41 on hv-cinder-81565 May 12 20:42:41.893659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-66b6ce66-c38f-4151-b356-f0efcc7f4fdd req-8947f6f7-e3ad-4e41-b9c9-4a91a8554049 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037726 May 12 20:42:41.894270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 329/696] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:41.999466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:42.000293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:42.006723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:42.007257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:42.008207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:42.009489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:42.072457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:42.080193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a667aa5e-7769-4a6b-9735-06f8b70d2759 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 200 len: 1293 microversion: 2.1 time: 0.084905 May 12 20:42:42.080781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 330/697] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:41 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:42.216104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a26ef8eb-2fb0-4ba3-98d0-9441a374f80a tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action" status: 202 len: 0 microversion: 2.1 time: 0.757936 May 12 20:42:42.216983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 368/698] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:42:41 2022] POST /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:43.096121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:43.096818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: eac2486e-2cc0-43d2-b384-4249cab22a41] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:43.102885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.103434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.104277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.104792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.120253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] HTTP exception thrown: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Request method failure captured: May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 HTTP/1.1 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz1nlroBCS0z9CAFGhOAWRaQrvgY3sdBRyvmLUWpqZRCr4DZ6SqTkMaldH6lEflE8tNJvN1W1-kIe50dc6LkQB5FPvsJXGfRn5qbZZoiBz9xG66YcTprXNYFPtttmGCcDp8kjNkb4tAvIbUatUy3rwt0HG1EU_iza49vMuuHTKSQw May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:42:43.121982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_500b58188f1a4a088b52b67eb5772984", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 2a2b95ccb7804311a011f37ccb371771 May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. May 12 20:42:43.123573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'eac2486e-2cc0-43d2-b384-4249cab22a41'} May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:43.124494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. May 12 20:42:43.126064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:43.127736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Returning 404 to user: Instance eac2486e-2cc0-43d2-b384-4249cab22a41 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:43.127736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c075b4c4-3d17-4be8-b468-246abeef04c7 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41" status: 404 len: 111 microversion: 2.1 time: 0.031402 May 12 20:42:43.127736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 331/699] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:43 2022] GET /compute/v2.1/servers/eac2486e-2cc0-43d2-b384-4249cab22a41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:43.133879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:43.134705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:43.141044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.141706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.142547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.143054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.169340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:43.470516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7ea7b93f-44db-425a-84fa-a33f5d9fd846 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 204 len: 0 microversion: 2.1 time: 0.341576 May 12 20:42:43.471295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 369/700] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:42:43 2022] DELETE /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 20:42:43.482814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:43.483496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:43.490728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.496005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.496005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.496005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.627030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:43.635654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0a1a9ea8-e040-4241-ba75-96eb60f6203d tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.159402 May 12 20:42:43.636444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 332/701] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:43 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:43.711563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:43.712323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:43.718290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.718756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.719503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.719935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.801148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lazy-loading 'services' on Instance uuid ca220cf9-38d5-417d-94f9-e98a00292d11 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:43.917769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}, {"name": "network-changed", "server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:43.928324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:43.929016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:43.942614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] Creating event network-changed:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:42:43.943126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] Creating event network-changed:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:42:43.948460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-2d60f3a6-765e-4c67-b10f-c0905c75fb03 req-0be0f6fd-a1bf-40c9-82d9-2b3caab36be8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035831 May 12 20:42:43.949054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 333/702] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:42:44.074723 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a16205e5-31e8-4898-9bc7-da9e18258a73 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments/35dadfb8-6ef5-42be-9afd-4cf2d0ddd610" status: 202 len: 0 microversion: 2.1 time: 0.367310 May 12 20:42:44.075350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 370/703] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:42:43 2022] DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments/35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:44.084607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:44.085768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:44.092709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:44.095595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:44.095595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:44.095595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:44.124006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-44f5b4d2-cadb-456b-88a8-989964b261db tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 May 12 20:42:44.124699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 334/704] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:44 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:42:44.653824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:44.654518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:44.660522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:44.660969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:44.661748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:44.662187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:44.795034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:44.802329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2ff918e4-57a6-4532-b971-f824f88e6ba9 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.153347 May 12 20:42:44.802897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 371/705] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:44 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:45.137181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:45.143080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:45.144415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:45.144858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:45.145642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:45.146076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:45.176552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4defe24a-4a69-40a1-a7a3-f67389648ceb tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 May 12 20:42:45.181159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 335/706] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:45 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:45.819475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:45.820089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:45.826508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:45.826953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:45.827715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:45.828154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:45.956574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:45.963849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7a7334e0-2ab1-4558-bd3c-1acbd1b453e3 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.148258 May 12 20:42:45.964410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 372/707] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:45 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:46.190075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:46.190914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:46.197346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:46.197802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:46.198568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:46.199007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:46.226407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0fa0736f-7cf0-4c2b-96b9-bfb346c0080e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040368 May 12 20:42:46.227469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 336/708] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:46 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:46.980846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:46.981494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:46.987772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:46.988220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:46.988977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:46.989450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:47.118684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:47.125881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b07c406-7028-429a-b8b5-a52da589fe1e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1521 microversion: 2.1 time: 0.149362 May 12 20:42:47.126442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 373/709] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:46 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:47.238609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:47.240403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:47.247588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:47.248328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:47.249203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:47.249824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:47.280633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-27746056-b051-41da-be21-5de1f6504a10 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 May 12 20:42:47.281228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 337/710] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:47 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:47.724699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-0c73010a-2e4e-40b8-80a6-dabe76c75cd8 req-9c0f7be1-f2f6-4177-977f-2e9c225262ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a63ea-b229-4fd8-afd1-e8d6c28c1248", "name": "network-vif-deleted", "tag": "e613f8bc-8de6-4b77-bfee-c36f3c4c5106"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:47.733525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-0c73010a-2e4e-40b8-80a6-dabe76c75cd8 req-9c0f7be1-f2f6-4177-977f-2e9c225262ec service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:47.734034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-0c73010a-2e4e-40b8-80a6-dabe76c75cd8 req-9c0f7be1-f2f6-4177-977f-2e9c225262ec service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:47.748532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-0c73010a-2e4e-40b8-80a6-dabe76c75cd8 req-9c0f7be1-f2f6-4177-977f-2e9c225262ec service nova] Creating event network-vif-deleted:e613f8bc-8de6-4b77-bfee-c36f3c4c5106 for instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 on hv-cinder-81565 May 12 20:42:47.753431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-0c73010a-2e4e-40b8-80a6-dabe76c75cd8 req-9c0f7be1-f2f6-4177-977f-2e9c225262ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 May 12 20:42:47.756378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 374/711] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:42:48.143042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:48.143658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:48.150172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.150623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.151391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.151827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.189206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.189206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.189206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lazy-loading 'fault' on Instance uuid 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:42:48.229567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2b95ccb7804311a011f37ccb371771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500b58188f1a4a088b52b67eb5772984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:48.236932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f1e968b-8d9c-4d52-8aad-ab506eb582b2 tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 200 len: 1312 microversion: 2.1 time: 0.097765 May 12 20:42:48.237521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 338/712] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:48 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:48.293161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:48.294123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:48.300148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.300595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.301376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.301808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.329500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ccf8d8df-573e-46c9-8992-836dcc3534d0 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041221 May 12 20:42:48.330045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 375/713] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:42:48 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:42:48.340367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:48.340879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:48.347315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.347773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.348535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:48.348976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:48.421118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] HTTP exception thrown: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 is not attached to volume 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Request method failure captured: May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments/35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 HTTP/1.1 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXCNLmDoqBtRDQJLKXAMTJgQwtlkXMLpAhY9xJSQL2_L59V9n4iEGjT7yzVYUKOJRrDrOz1O3jRQEMTq_h5rgRn903uVbmrvrIcNWISa7no4HT2po5DqXQxxPLtIbVQoaB4OGxMuL0AcykPh7FfUpKyl-MB4PoK8Gp3KVhSX6ioysZw May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: fcbad83733994c35979d60f1bbaf280c May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:42:48.431733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fcbad83733994c35979d60f1bbaf280c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: fcbad83733994c35979d60f1bbaf280c May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestMinimumBasicScenario-1737982509-project May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: d6afc66e1d4b473e9a8e6abf1737b64d May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestMinimumBasicScenario-1737982509-project May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:42:48.433314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 is not attached to volume 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': 'ca220cf9-38d5-417d-94f9-e98a00292d11', 'id': '35dadfb8-6ef5-42be-9afd-4cf2d0ddd610'} May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610. May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:48.434196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 is not attached to volume 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 is not attached to volume 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:48.435562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Returning 404 to user: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 is not attached to volume 35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:48.436670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ac3dabea-8ba6-4905-9ef9-83716cffcc36 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments/35dadfb8-6ef5-42be-9afd-4cf2d0ddd610" status: 404 len: 154 microversion: 2.1 time: 0.097548 May 12 20:42:48.436670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 339/714] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:42:48 2022] DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11/os-volume_attachments/35dadfb8-6ef5-42be-9afd-4cf2d0ddd610 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:49.253897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:49.254516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] [instance: 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:49.260929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:49.266585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:49.266585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:49.266585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:49.275832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] HTTP exception thrown: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Request method failure captured: May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 HTTP/1.1 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz1nlroBCS0z9CAFGhOAWRaQrvgY3sdBRyvmLUWpqZRCr4DZ6SqTkMaldH6lEflE8tNJvN1W1-kIe50dc6LkQB5FPvsJXGfRn5qbZZoiBz9xG66YcTprXNYFPtttmGCcDp8kjNkb4tAvIbUatUy3rwt0HG1EU_iza49vMuuHTKSQw May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:42:49.277509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_500b58188f1a4a088b52b67eb5772984", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/500b58188f1a4a088b52b67eb5772984"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 500b58188f1a4a088b52b67eb5772984 May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-448728332 May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 2a2b95ccb7804311a011f37ccb371771 May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-448728332-project May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. May 12 20:42:49.278927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '7f0a63ea-b229-4fd8-afd1-e8d6c28c1248'} May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:49.279671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. May 12 20:42:49.280806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:42:49.281898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] Returning 404 to user: Instance 7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:49.281898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3f0aa8b6-d24b-4059-976a-aa429c7ade8e tempest-ServerRescueNegativeTestJSON-448728332 tempest-ServerRescueNegativeTestJSON-448728332-project] 10.222.0.59 "GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248" status: 404 len: 111 microversion: 2.1 time: 0.028814 May 12 20:42:49.281898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 376/715] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:49 2022] GET /compute/v2.1/servers/7f0a63ea-b229-4fd8-afd1-e8d6c28c1248 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:49.741134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:49.741674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:49.748312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:49.748752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:49.749544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:49.749979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:49.776078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:42:50.067707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-95f179c9-21ae-40f1-9c00-a5339bce8acd tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 204 len: 0 microversion: 2.1 time: 0.330158 May 12 20:42:50.068651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 340/716] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:42:49 2022] DELETE /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:42:50.077380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:50.077993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:50.084107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:50.084558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:50.085341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:50.085778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:50.291716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:50.299246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0579044a-c4f2-4566-915e-2e01eddf982e tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1553 microversion: 2.1 time: 0.225710 May 12 20:42:50.299811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 377/717] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:50 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:51.316859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:51.317692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:51.324848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:51.325636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:51.326429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:51.326869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:51.561751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:51.574922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4d69b55-78d4-44d1-801d-1da9e90d1ce7 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1553 microversion: 2.1 time: 0.260793 May 12 20:42:51.574922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 341/718] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:51 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:42:52.591533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:52.592146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:52.599026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:52.601176 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:52.602327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:52.602776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:52.606322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-37b1906b-896c-4746-80c3-010c198a773c req-4e404a47-5acf-4a47-a132-414325e62b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca220cf9-38d5-417d-94f9-e98a00292d11", "name": "network-vif-deleted", "tag": "57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:52.624438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-37b1906b-896c-4746-80c3-010c198a773c req-4e404a47-5acf-4a47-a132-414325e62b1e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:52.625120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-37b1906b-896c-4746-80c3-010c198a773c req-4e404a47-5acf-4a47-a132-414325e62b1e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:52.641612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-37b1906b-896c-4746-80c3-010c198a773c req-4e404a47-5acf-4a47-a132-414325e62b1e service nova] Creating event network-vif-deleted:57ebc0dc-fa17-4e6f-8aa1-22a2e6352c47 for instance ca220cf9-38d5-417d-94f9-e98a00292d11 on hv-cinder-81565 May 12 20:42:52.647774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-37b1906b-896c-4746-80c3-010c198a773c req-4e404a47-5acf-4a47-a132-414325e62b1e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045308 May 12 20:42:52.652413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 342/719] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:52.998237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6afc66e1d4b473e9a8e6abf1737b64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbad83733994c35979d60f1bbaf280c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:42:53.004711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c95d1d44-50d3-4fd7-a865-4bbf387ad2bf tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 200 len: 1511 microversion: 2.1 time: 0.418033 May 12 20:42:53.005609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 378/720] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:52 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:42:54.023008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:54.023795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] [instance: ca220cf9-38d5-417d-94f9-e98a00292d11] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:42:54.030260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:54.030704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:54.031482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:42:54.031918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:42:54.045062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] HTTP exception thrown: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Request method failure captured: May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 HTTP/1.1 May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXCNLmDoqBtRDQJLKXAMTJgQwtlkXMLpAhY9xJSQL2_L59V9n4iEGjT7yzVYUKOJRrDrOz1O3jRQEMTq_h5rgRn903uVbmrvrIcNWISa7no4HT2po5DqXQxxPLtIbVQoaB4OGxMuL0AcykPh7FfUpKyl-MB4PoK8Gp3KVhSX6ioysZw May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: fcbad83733994c35979d60f1bbaf280c May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:42:54.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fcbad83733994c35979d60f1bbaf280c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fcbad83733994c35979d60f1bbaf280c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: fcbad83733994c35979d60f1bbaf280c May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1737982509 May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestMinimumBasicScenario-1737982509-project May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: d6afc66e1d4b473e9a8e6abf1737b64d May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestMinimumBasicScenario-1737982509-project May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. May 12 20:42:54.048421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'ca220cf9-38d5-417d-94f9-e98a00292d11'} May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:42:54.054093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. May 12 20:42:54.056077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:42:54.057394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Returning 404 to user: Instance ca220cf9-38d5-417d-94f9-e98a00292d11 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:42:54.057394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9d6d793d-c0ef-4485-8dab-35563b4aee58 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11" status: 404 len: 111 microversion: 2.1 time: 0.029390 May 12 20:42:54.057394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 343/721] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:42:54 2022] GET /compute/v2.1/servers/ca220cf9-38d5-417d-94f9-e98a00292d11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:42:54.058162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b0324e41-5ab2-4c92-89a6-ec0bdda36321 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] Calling method '.version_select at 0x7f4e62df4d30>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:54.169195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b0324e41-5ab2-4c92-89a6-ec0bdda36321 tempest-TestMinimumBasicScenario-1737982509 tempest-TestMinimumBasicScenario-1737982509-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-308251166" status: 202 len: 0 microversion: 2.1 time: 0.116044 May 12 20:42:54.170245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 379/722] 10.222.0.59 () {58 vars in 1268 bytes} [Thu May 12 20:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-308251166 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:42:55.290887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5ccbfca-db4f-43aa-b6a4-36863af2ddef tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Action: 'create', calling method: .version_select at 0x7f4e62ccec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-206064651"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:55.976102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e5ccbfca-db4f-43aa-b6a4-36863af2ddef tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.800323 May 12 20:42:55.977236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 344/723] 10.222.0.59 () {60 vars in 1154 bytes} [Thu May 12 20:42:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 802 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 20:42:55.988437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a59f2b84-c81f-43a2-8d96-a10b79e45256 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e6c05f9d0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:56.039484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a59f2b84-c81f-43a2-8d96-a10b79e45256 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 200 len: 344 microversion: 2.1 time: 0.054709 May 12 20:42:56.040501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 380/724] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:42:55 2022] GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:57.052518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-290fa7a0-0592-4aa4-b907-66fa405dd5b2 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62cd4b80>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:57.100232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-290fa7a0-0592-4aa4-b907-66fa405dd5b2 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 200 len: 345 microversion: 2.1 time: 0.052122 May 12 20:42:57.100807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 345/725] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:42:57 2022] GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:57.112506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e238290f-126f-4692-987c-f2d1b0a917d6 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Action: 'create', calling method: .version_select at 0x7f4e6c09d700>, body: {"snapshot": {"volume_id": "faabc8c2-59d5-4fea-862b-0db82ac1f78c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-376113134"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:42:57.645642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e238290f-126f-4692-987c-f2d1b0a917d6 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.534914 May 12 20:42:57.645642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 381/726] 10.222.0.59 () {60 vars in 1161 bytes} [Thu May 12 20:42:57 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:57.656598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-29179f3b-7a7d-481f-944f-86c33505e8c9 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e541f0>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:57.690581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-29179f3b-7a7d-481f-944f-86c33505e8c9 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 286 microversion: 2.1 time: 0.039845 May 12 20:42:57.691759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 346/727] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:42:57 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:57.702348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a24f899-b204-42fa-9410-ed91c63284f6 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e3bf70>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:57.735055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a24f899-b204-42fa-9410-ed91c63284f6 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036733 May 12 20:42:57.735983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 382/728] 10.222.0.59 () {58 vars in 1139 bytes} [Thu May 12 20:42:57 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:57.746975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60eb3083-ab08-473c-9a6e-e9f30d4a84a2 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62d08550>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:57.781635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60eb3083-ab08-473c-9a6e-e9f30d4a84a2 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 286 microversion: 2.1 time: 0.039410 May 12 20:42:57.786615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 347/729] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:42:57 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:58.794072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b340ed70-2bda-4432-8b77-f73576eb31c5 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62df4d30>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:58.839312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b340ed70-2bda-4432-8b77-f73576eb31c5 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 286 microversion: 2.1 time: 0.049456 May 12 20:42:58.839988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 383/730] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:42:58 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:42:59.852648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4f68f0e-f972-4878-8f5b-7516a3a49151 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62cced30>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:42:59.937974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4f68f0e-f972-4878-8f5b-7516a3a49151 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 286 microversion: 2.1 time: 0.090248 May 12 20:42:59.938574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 348/731] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:42:59 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:00.909825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:00.910719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:00.918718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:00.919301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:00.920414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:00.921064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:00.950171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ef9ff11c-e9ef-4546-b8cb-cfead51418f8 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62d08c10>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:00.951886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ea650fb7-37d4-4d77-ba51-fd49794b4777 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045897 May 12 20:43:00.952799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 384/732] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:43:00 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:43:00.984878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ef9ff11c-e9ef-4546-b8cb-cfead51418f8 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 287 microversion: 2.1 time: 0.039764 May 12 20:43:00.985485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 349/733] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:43:00 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:00.995501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7c77930e-02ae-463e-a222-7c0276d2ad22 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e6c099550>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:01.012531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:01.013039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:01.019491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:01.019951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:01.020734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:01.021175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:01.051777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:43:01.122396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7c77930e-02ae-463e-a222-7c0276d2ad22 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 202 len: 0 microversion: 2.1 time: 0.130708 May 12 20:43:01.122973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 385/734] 10.222.0.59 () {58 vars in 1253 bytes} [Thu May 12 20:43:00 2022] DELETE /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:43:01.133935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a0989d6-d3b7-4c7c-813b-126ca208f15e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e3be50>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:01.167224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a0989d6-d3b7-4c7c-813b-126ca208f15e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 200 len: 286 microversion: 2.1 time: 0.039390 May 12 20:43:01.167799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 386/735] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:43:01 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:01.357348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3294df15-424f-4f87-a50b-0609be2bb357 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 204 len: 0 microversion: 2.1 time: 0.348238 May 12 20:43:01.357953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 350/736] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:43:01 2022] DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 20:43:01.366179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:01.366795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:01.373233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:01.373649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:01.374416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:01.375028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:01.598683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:01.607330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-140f4695-7bbb-4f1b-9812-5c2987ab11e7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1675 microversion: 2.1 time: 0.244968 May 12 20:43:01.608303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 387/737] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:01 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:02.180114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7e7caced-428f-4b30-93a8-e87e6f649f4e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62cceb80>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:02.204909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-7e7caced-428f-4b30-93a8-e87e6f649f4e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] HTTP exception thrown: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7e7caced-428f-4b30-93a8-e87e6f649f4e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Request method failure captured: May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f HTTP/1.1 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXFP9Zt-TOu9YZQTckVYRf7vtlagNgDhPkozIwCdraCFoKoPDKTvczKZQ-uJDqL5Fs03Lb1dqhAP4EX1smIpK3dkzarrFI6vbmCkk_vhXqb6_S17MQwRdlOx1B5y-KH7o9kS-JqPLUl9pm7FzFPQqKxJ826eR1KVGgyV90mty4F4ERU May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:02.207496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8fb25cc42cb64f07a42dc479e5a6c5e6", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: c813e15872d84a9bbce3f390df06a0b7 May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '3addc115-5aa7-4c37-8a09-188417a3b53f'} May 12 20:43:02.208992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. (HTTP 404) (Request-ID: req-15f6bcbe-f8f5-41ca-8b7c-999efc8d754f) May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.210333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:02.212261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 20:43:02.213638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. May 12 20:43:02.215165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:02.218086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7e7caced-428f-4b30-93a8-e87e6f649f4e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Returning 404 to user: Snapshot 3addc115-5aa7-4c37-8a09-188417a3b53f could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:02.218987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7e7caced-428f-4b30-93a8-e87e6f649f4e tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f" status: 404 len: 111 microversion: 2.1 time: 0.043422 May 12 20:43:02.219820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 351/738] 10.222.0.59 () {58 vars in 1250 bytes} [Thu May 12 20:43:02 2022] GET /compute/v2.1/os-snapshots/3addc115-5aa7-4c37-8a09-188417a3b53f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:02.229050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1aa87605-b17b-4953-b0e9-c6ff9d5581f0 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e3bd30>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:02.266879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:02.267502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:02.275095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:02.275547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:02.276396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:02.276842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:02.300693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-999afe9d-76b4-4a23-a892-abf781817cc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/ips" status: 200 len: 150 microversion: 2.1 time: 0.039250 May 12 20:43:02.301269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 352/739] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:43:02 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:02.417861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1aa87605-b17b-4953-b0e9-c6ff9d5581f0 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 202 len: 0 microversion: 2.1 time: 0.188843 May 12 20:43:02.417861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 388/740] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:43:02 2022] DELETE /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:43:02.423573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5b68493b-b62f-4fde-91e8-fde88023bb7d tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e4fa60>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:02.470412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5b68493b-b62f-4fde-91e8-fde88023bb7d tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 200 len: 344 microversion: 2.1 time: 0.050805 May 12 20:43:02.470982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 353/741] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:43:02 2022] GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:02.629991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:02.631245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:02.640307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:02.640760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:02.642113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:02.642562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:02.839622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:02.847710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-09dbaaa1-f25a-4b60-acdf-c662c78dd9a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1675 microversion: 2.1 time: 0.226298 May 12 20:43:02.847898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 389/742] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:02 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:03.484602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-055e09c6-ec5f-48bc-b464-1afae4ab4685 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62f0cca0>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:03.543054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-055e09c6-ec5f-48bc-b464-1afae4ab4685 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] HTTP exception thrown: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-055e09c6-ec5f-48bc-b464-1afae4ab4685 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Request method failure captured: May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c HTTP/1.1 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXFP9Zt-TOu9YZQTckVYRf7vtlagNgDhPkozIwCdraCFoKoPDKTvczKZQ-uJDqL5Fs03Lb1dqhAP4EX1smIpK3dkzarrFI6vbmCkk_vhXqb6_S17MQwRdlOx1B5y-KH7o9kS-JqPLUl9pm7FzFPQqKxJ826eR1KVGgyV90mty4F4ERU May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:03.547419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8fb25cc42cb64f07a42dc479e5a6c5e6", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: c813e15872d84a9bbce3f390df06a0b7 May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'faabc8c2-59d5-4fea-862b-0db82ac1f78c'} May 12 20:43:03.549428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. (HTTP 404) (Request-ID: req-c863a515-8b40-4aef-8ed7-1a52c4b313b6) May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.550513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:03.551819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 20:43:03.553241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.555228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-055e09c6-ec5f-48bc-b464-1afae4ab4685 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Returning 404 to user: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:03.558815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-055e09c6-ec5f-48bc-b464-1afae4ab4685 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 404 len: 109 microversion: 2.1 time: 0.076385 May 12 20:43:03.559049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 354/743] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:43:03 2022] GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:03.577474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52f8f6bd-1dc5-45aa-a867-c69ada945feb tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62da6dc0>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:03.609897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-52f8f6bd-1dc5-45aa-a867-c69ada945feb tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] HTTP exception thrown: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52f8f6bd-1dc5-45aa-a867-c69ada945feb tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Request method failure captured: May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c HTTP/1.1 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXFP9Zt-TOu9YZQTckVYRf7vtlagNgDhPkozIwCdraCFoKoPDKTvczKZQ-uJDqL5Fs03Lb1dqhAP4EX1smIpK3dkzarrFI6vbmCkk_vhXqb6_S17MQwRdlOx1B5y-KH7o9kS-JqPLUl9pm7FzFPQqKxJ826eR1KVGgyV90mty4F4ERU May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:43:03.612450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8fb25cc42cb64f07a42dc479e5a6c5e6", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: c813e15872d84a9bbce3f390df06a0b7 May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': 'faabc8c2-59d5-4fea-862b-0db82ac1f78c'} May 12 20:43:03.614064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. (HTTP 404) (Request-ID: req-ca30de24-00e2-430a-bc04-cd6da0a5a97b) May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.618035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 20:43:03.619272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 20:43:03.620404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52f8f6bd-1dc5-45aa-a867-c69ada945feb tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Returning 404 to user: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-52f8f6bd-1dc5-45aa-a867-c69ada945feb tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 404 len: 109 microversion: 2.1 time: 0.043124 May 12 20:43:03.621672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 390/744] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:43:03 2022] DELETE /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:03.624042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3943a66c-45f7-436e-9f57-fd9bab2d7848 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Calling method '.version_select at 0x7f4e62e541f0>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:03.813353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-3943a66c-45f7-436e-9f57-fd9bab2d7848 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] HTTP exception thrown: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3943a66c-45f7-436e-9f57-fd9bab2d7848 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Request method failure captured: May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c HTTP/1.1 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXFP9Zt-TOu9YZQTckVYRf7vtlagNgDhPkozIwCdraCFoKoPDKTvczKZQ-uJDqL5Fs03Lb1dqhAP4EX1smIpK3dkzarrFI6vbmCkk_vhXqb6_S17MQwRdlOx1B5y-KH7o9kS-JqPLUl9pm7FzFPQqKxJ826eR1KVGgyV90mty4F4ERU May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:03.815350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8fb25cc42cb64f07a42dc479e5a6c5e6", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8fb25cc42cb64f07a42dc479e5a6c5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 8fb25cc42cb64f07a42dc479e5a6c5e6 May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112693733 May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: c813e15872d84a9bbce3f390df06a0b7 May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112693733-project May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'faabc8c2-59d5-4fea-862b-0db82ac1f78c'} May 12 20:43:03.816811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. (HTTP 404) (Request-ID: req-a00da45b-4ca1-4c90-aaa8-2d54d17579a2) May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.817749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 20:43:03.819315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 20:43:03.821161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3943a66c-45f7-436e-9f57-fd9bab2d7848 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] Returning 404 to user: Volume faabc8c2-59d5-4fea-862b-0db82ac1f78c could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3943a66c-45f7-436e-9f57-fd9bab2d7848 tempest-VolumesSnapshotsTestJSON-2112693733 tempest-VolumesSnapshotsTestJSON-2112693733-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c" status: 404 len: 109 microversion: 2.1 time: 0.198009 May 12 20:43:03.822539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 355/745] 10.222.0.59 () {58 vars in 1244 bytes} [Thu May 12 20:43:03 2022] GET /compute/v2.1/os-volumes/faabc8c2-59d5-4fea-862b-0db82ac1f78c => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:03.864406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:03.868966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:03.874852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:03.875301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:03.876067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:03.876507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:04.014120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3c71a65-3dd6-4249-b6f4-40cff6b2df30"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:04.015239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:04.022078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:04.022534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:04.024294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:04.024739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:04.034552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:04.043394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-978f9fab-576e-4e01-9026-0e18ecffb916 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1675 microversion: 2.1 time: 0.182686 May 12 20:43:04.055042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 391/746] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:03 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:04.793126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-32cbb805-e789-494b-b7b4-0eec06d976fe tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785398 May 12 20:43:04.793126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 356/747] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:43:04 2022] POST /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:05.077666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:05.078399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:05.089775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:05.090427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:05.091305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:05.091791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:05.116296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-2c9d7c92-ad3d-4aa3-b8c2-e0d2e8651c56 req-02eabc8d-a054-4000-8f93-51e99c6b92ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbc0365-6647-411e-9225-26ead37c724d", "name": "network-vif-deleted", "tag": "b94b2dd5-2c01-445f-ab87-f2c09a146bfa"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:05.125336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2c9d7c92-ad3d-4aa3-b8c2-e0d2e8651c56 req-02eabc8d-a054-4000-8f93-51e99c6b92ab service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:05.125788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2c9d7c92-ad3d-4aa3-b8c2-e0d2e8651c56 req-02eabc8d-a054-4000-8f93-51e99c6b92ab service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:05.141433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-2c9d7c92-ad3d-4aa3-b8c2-e0d2e8651c56 req-02eabc8d-a054-4000-8f93-51e99c6b92ab service nova] Creating event network-vif-deleted:b94b2dd5-2c01-445f-ab87-f2c09a146bfa for instance 0fbc0365-6647-411e-9225-26ead37c724d on hv-cinder-81565 May 12 20:43:05.146506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-2c9d7c92-ad3d-4aa3-b8c2-e0d2e8651c56 req-02eabc8d-a054-4000-8f93-51e99c6b92ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034278 May 12 20:43:05.147503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 357/748] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:05.190824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:05.205623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0354a599-9d78-4563-ada4-20390c4f3a6f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 200 len: 1607 microversion: 2.1 time: 0.147910 May 12 20:43:05.218872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 392/749] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:05 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 1607 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:06.226527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:06.228085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:06.237162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:06.257535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:06.257535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:06.257535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:06.257535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d HTTP/1.1 May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:06.259297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 20:43:06.260652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0fbc0365-6647-411e-9225-26ead37c724d'} May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:06.261400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 20:43:06.262505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:06.263544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:06.263544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aeb2a812-dd4c-424e-9ec4-a823f4e2820c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 404 len: 111 microversion: 2.1 time: 0.039457 May 12 20:43:06.263544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 358/750] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:06 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:06.270128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e0d98f6-918f-4e0f-8973-d9b59545c156 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '.version_select at 0x7f4e6c09d160>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:06.356608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e0d98f6-918f-4e0f-8973-d9b59545c156 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692626225" status: 202 len: 0 microversion: 2.1 time: 0.090441 May 12 20:43:06.357203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 393/751] 10.222.0.59 () {58 vars in 1220 bytes} [Thu May 12 20:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692626225 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:43:07.185854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f243e62-b8a4-4d94-ac08-bf3b76df8410 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: .version_select at 0x7f4e62d4c1f0>, body: {"keypair": {"name": "tempest-keypair-1006571929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLmmnvImo40vYFlsWlv5BL//g+SJgW5r8QdSHWSK0t2wr/TVuVl8gWVVHzEbXBxGJ/C34MOWBn+cSR07/bzx67fpEHqLnSuX6jsHINJfh0QXU8iR44YSKlDJ506fK5KJQ=="}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:07.201516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-1f243e62-b8a4-4d94-ac08-bf3b76df8410 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for project 726b268af80347bbbf58e80cef5c61bc. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:07.205694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-1f243e62-b8a4-4d94-ac08-bf3b76df8410 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for user e3fa08cd466c419e80198a5b44b719f9 and project 726b268af80347bbbf58e80cef5c61bc. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:07.295121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f243e62-b8a4-4d94-ac08-bf3b76df8410 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112226 May 12 20:43:07.296952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 359/752] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:43:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:10.102023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-44493834", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59ab41f8-7e85-4688-bb20-32bdbdb0f9ea"}], "security_groups": [{"name": "tempest-securitygroup--960193776"}], "key_name": "tempest-keypair-1006571929", "user_data": "}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:10.250397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] validate_networks() for [('59ab41f8-7e85-4688-bb20-32bdbdb0f9ea', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:43:10.694423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:43:10.694890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:43:10.695455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:43:10.695989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:43:10.696442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:43:10.707904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:10.708382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:10.709612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:10.710062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:10.735674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for project 726b268af80347bbbf58e80cef5c61bc. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:10.744211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Getting quotas for user e3fa08cd466c419e80198a5b44b719f9 and project 726b268af80347bbbf58e80cef5c61bc. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:10.783690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:43:10.791798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:43:10.993480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4fae265a-049a-48fd-898c-d213c8023330 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.902378 May 12 20:43:10.994705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 394/753] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:43:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:43:11.006764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53ff254d-be2d-4470-a45c-6a773e5b0e1a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:11.010139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53ff254d-be2d-4470-a45c-6a773e5b0e1a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:11.096515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-53ff254d-be2d-4470-a45c-6a773e5b0e1a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:11.105201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53ff254d-be2d-4470-a45c-6a773e5b0e1a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1236 microversion: 2.1 time: 0.104573 May 12 20:43:11.116107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 360/754] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1236 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:12.123643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-57c7024a-23a6-43f9-a9f2-0062381b02d9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:12.124806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-57c7024a-23a6-43f9-a9f2-0062381b02d9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:12.192115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-57c7024a-23a6-43f9-a9f2-0062381b02d9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:12.199665 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-57c7024a-23a6-43f9-a9f2-0062381b02d9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1236 microversion: 2.1 time: 0.080440 May 12 20:43:12.200379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 395/755] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:12.704327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3c71a65-3dd6-4249-b6f4-40cff6b2df30"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:12.706124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:12.714972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:12.716341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:12.718390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:12.719190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:12.825678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: POST /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments HTTP/1.1 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 74 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:12.827369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {"volumeAttachment": {"volumeId": "c3c71a65-3dd6-4249-b6f4-40cff6b2df30"}} May 12 20:43:12.828975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': '31e51169-24f1-4938-b088-951b5795a799', 'body': {'volumeAttachment': {'volumeId': 'c3c71a65-3dd6-4249-b6f4-40cff6b2df30'}}} May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:12.830035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:12.831438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:12.832901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:12.832901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:12.832901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:12.832901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 May 12 20:43:12.832901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:12.834567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 400 to user: Invalid volume: volume c3c71a65-3dd6-4249-b6f4-40cff6b2df30 is already attached to instances: 31e51169-24f1-4938-b088-951b5795a799 {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:12.835725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9e9498b3-41f6-430b-a67d-f434edd325a7 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137619 May 12 20:43:12.836287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 361/756] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:43:12 2022] POST /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:43:12.908215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:12.910055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:12.934066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:12.939402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:12.940840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:12.941535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:13.049521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'services' on Instance uuid 31e51169-24f1-4938-b088-951b5795a799 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:43:13.218346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:13.219313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:13.228835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:13.229648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:13.230612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:13.231253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:13.322662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11f2ccda-505e-44c7-b3de-374d52b9720d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments/c3c71a65-3dd6-4249-b6f4-40cff6b2df30" status: 202 len: 0 microversion: 2.1 time: 0.419803 May 12 20:43:13.323809 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 396/757] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:43:12 2022] DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments/c3c71a65-3dd6-4249-b6f4-40cff6b2df30 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:43:13.339578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:13.342205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:13.360097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:13.365584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:13.367377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:13.367833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:13.372375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:13.383741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8e0903dc-1250-4cd7-a50f-f1b342f5109e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1288 microversion: 2.1 time: 0.170756 May 12 20:43:13.387204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 362/758] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1288 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:13.433667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3ba5d57e-1c03-4048-8d62-30d2c2949c8e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105058 May 12 20:43:13.440505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 397/759] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:43:13 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:14.410059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:14.411367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:14.419400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.419890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.420668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.421102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.449648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:14.451016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:14.458330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.458883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.459887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.461352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.504341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-adbcd534-9a1a-4173-b841-eb20bc98dfc1 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060786 May 12 20:43:14.505132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 398/760] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:43:14 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 20:43:14.570655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:14.581212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7a650402-a85f-4620-95ec-ad4841e3ff15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1294 microversion: 2.1 time: 0.174284 May 12 20:43:14.605623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 363/761] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1294 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:14.613684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:14.614812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:14.622621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.624043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.625016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:14.625667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:14.671549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:43:15.069083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-03d0a1f7-a37a-4311-8641-0a44ed510e7d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 204 len: 0 microversion: 2.1 time: 0.459321 May 12 20:43:15.077924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 399/762] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:43:14 2022] DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:43:15.091423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:15.092267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:15.098683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:15.099656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:15.100690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:15.102012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:15.324518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:15.347250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-662c7914-bf87-4a95-b3ad-41cc77d10524 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1681 microversion: 2.1 time: 0.260883 May 12 20:43:15.347859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 364/763] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:15 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:15.607225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:15.609400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:15.618696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:15.619388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:15.621967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:15.621967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:15.931337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:15.943749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-66e3c54e-9dd5-40d3-bf3b-51f9c7881d3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.340029 May 12 20:43:15.945377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 400/764] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:16.220644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-9c3e16dd-4a59-4842-a213-4410dc83e236 req-6451b3bb-d000-43ed-b7af-e7fd908129a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5583a9e-213d-4250-afa6-8a77981ef335", "tag": "a86b8e9b-9010-40d0-a396-b8285e4fabfe"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:16.230240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9c3e16dd-4a59-4842-a213-4410dc83e236 req-6451b3bb-d000-43ed-b7af-e7fd908129a3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:16.230667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9c3e16dd-4a59-4842-a213-4410dc83e236 req-6451b3bb-d000-43ed-b7af-e7fd908129a3 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:16.252271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-9c3e16dd-4a59-4842-a213-4410dc83e236 req-6451b3bb-d000-43ed-b7af-e7fd908129a3 service nova] Creating event network-changed:a86b8e9b-9010-40d0-a396-b8285e4fabfe for instance c5583a9e-213d-4250-afa6-8a77981ef335 on hv-cinder-81565 May 12 20:43:16.259074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-9c3e16dd-4a59-4842-a213-4410dc83e236 req-6451b3bb-d000-43ed-b7af-e7fd908129a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042190 May 12 20:43:16.260459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 365/765] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:16.372416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:16.373537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:16.381195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:16.382638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:16.385172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:16.385874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:16.779066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:16.790297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c61598bc-a035-4af9-ad8f-068ef26b476b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1681 microversion: 2.1 time: 0.427222 May 12 20:43:16.800276 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 401/766] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:16 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1681 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:16.964312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:16.965416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:16.974060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:16.974799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:16.976810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:16.977527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:17.639977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:17.652660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-92d38c31-ea9c-4471-b26d-30df354fc97b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.693487 May 12 20:43:17.653321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 366/767] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:17.811651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:17.815067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:17.827753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:17.828668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:17.830055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:17.830767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:18.067357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:18.077156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ecf2d00e-7953-4f59-9b08-fc51a6bd2641 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1681 microversion: 2.1 time: 0.273302 May 12 20:43:18.078514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 402/768] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:17 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:18.671285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:18.674083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:18.682930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:18.687174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:18.687174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:18.687174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:19.045673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:19.046957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-2254a52b-eca8-490b-ac87-b0f5dea9cb6f req-7ab5c7ac-82c9-4369-a95e-c27eb3081f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e51169-24f1-4938-b088-951b5795a799", "name": "network-vif-deleted", "tag": "352714e9-fe37-4972-95f9-59c76534d0ab"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:19.055893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9c8f3564-6edc-4d7a-a38d-78ec1d1dbf16 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.388977 May 12 20:43:19.056810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 367/769] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:19.070631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-2254a52b-eca8-490b-ac87-b0f5dea9cb6f req-7ab5c7ac-82c9-4369-a95e-c27eb3081f3b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:19.071002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-2254a52b-eca8-490b-ac87-b0f5dea9cb6f req-7ab5c7ac-82c9-4369-a95e-c27eb3081f3b service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:19.091112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-2254a52b-eca8-490b-ac87-b0f5dea9cb6f req-7ab5c7ac-82c9-4369-a95e-c27eb3081f3b service nova] Creating event network-vif-deleted:352714e9-fe37-4972-95f9-59c76534d0ab for instance 31e51169-24f1-4938-b088-951b5795a799 on hv-cinder-81565 May 12 20:43:19.100992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-2254a52b-eca8-490b-ac87-b0f5dea9cb6f req-7ab5c7ac-82c9-4369-a95e-c27eb3081f3b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057889 May 12 20:43:19.102565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 403/770] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:19.116390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:19.120744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:19.151385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:19.151837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:19.152625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:19.157543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:19.261981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:19.271059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e146703c-917f-4ae4-ad0f-4efc9415aad8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 200 len: 1614 microversion: 2.1 time: 0.178767 May 12 20:43:19.277583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 368/771] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:19 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 1614 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:20.074584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:20.075288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:20.082989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:20.083924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:20.085762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:20.086797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:20.246045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:20.260802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-76937953-9eb6-459b-9f1f-7502cbbb4d86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.184150 May 12 20:43:20.261427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 404/772] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:20.293722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:20.295784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:20.305771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:20.306611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:20.307810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:20.308431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:20.333238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 HTTP/1.1 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:43:20.338403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 20:43:20.339901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '31e51169-24f1-4938-b088-951b5795a799'} May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:43:20.341000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 20:43:20.342566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:43:20.343759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:43:20.343759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b715f642-3c6d-4cf0-8833-ef421571305e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 404 len: 111 microversion: 2.1 time: 0.048743 May 12 20:43:20.343759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 369/773] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:20 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:43:20.345691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d1c22c14-c3dd-4725-b761-e75650933ac4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '.version_select at 0x7f4e6c09db80>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:20.424984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d1c22c14-c3dd-4725-b761-e75650933ac4 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239384042" status: 202 len: 0 microversion: 2.1 time: 0.083075 May 12 20:43:20.426106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 405/774] 10.222.0.59 () {58 vars in 1220 bytes} [Thu May 12 20:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239384042 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:43:21.289843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:21.292643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:21.328132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:21.330976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:21.333013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:21.333998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:21.681544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:21.682110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:21.691506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:21.691974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:21.692991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:21.693465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:21.727707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-78d8f876-be66-4740-856a-ca9bc96a255d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/ips" status: 200 len: 152 microversion: 2.20 time: 0.425413 May 12 20:43:21.728565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 406/775] 10.222.0.59 () {60 vars in 1288 bytes} [Thu May 12 20:43:21 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/ips => generated 152 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 20:43:21.750031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:21.763141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f559446f-5f89-43a9-8635-b4366376f859 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.487739 May 12 20:43:21.764128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 370/776] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:21.995426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-69eb9f86-a9ed-424a-8acd-83afc65c20b9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: .version_select at 0x7f4e6c0990d0>, body: {"keypair": {"name": "tempest-keypair-1448545032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWn+5A0dTuNgRVoyYrajSuC9j3vCafB/97nPS8cR5okByitRfU64a9treTS3qNE/zmwk9djmgsMbWEDv+bF4Aprg/0j2UrDuMFLxaD7olgtp7c2GZlV+IwkDZWLqe3oew=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:22.014010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-69eb9f86-a9ed-424a-8acd-83afc65c20b9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:22.024304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-69eb9f86-a9ed-424a-8acd-83afc65c20b9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:22.149330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-69eb9f86-a9ed-424a-8acd-83afc65c20b9 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158342 May 12 20:43:22.150523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 407/777] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:43:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:22.783596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:22.784223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:22.792474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:22.792879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:22.793703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:22.794137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:23.018708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:23.033434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0d242248-dcab-4443-b762-48cc6203c538 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.252435 May 12 20:43:23.034505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 371/778] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:23.485522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-1a0c2cd3-0f60-4db1-ab90-e8415c856b52 req-b35bdecd-c0b8-4e54-8370-96de4f024241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5583a9e-213d-4250-afa6-8a77981ef335", "name": "network-vif-plugged", "status": "completed", "tag": "a86b8e9b-9010-40d0-a396-b8285e4fabfe"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:23.495103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-1a0c2cd3-0f60-4db1-ab90-e8415c856b52 req-b35bdecd-c0b8-4e54-8370-96de4f024241 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:23.495554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-1a0c2cd3-0f60-4db1-ab90-e8415c856b52 req-b35bdecd-c0b8-4e54-8370-96de4f024241 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:23.517057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-1a0c2cd3-0f60-4db1-ab90-e8415c856b52 req-b35bdecd-c0b8-4e54-8370-96de4f024241 service nova] Creating event network-vif-plugged:a86b8e9b-9010-40d0-a396-b8285e4fabfe for instance c5583a9e-213d-4250-afa6-8a77981ef335 on hv-cinder-81565 May 12 20:43:23.522413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-1a0c2cd3-0f60-4db1-ab90-e8415c856b52 req-b35bdecd-c0b8-4e54-8370-96de4f024241 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040273 May 12 20:43:23.523907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 372/779] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:23.695693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ca5bf53e-2597-4367-af88-8e1ccbf1f5ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Action: 'create', calling method: .version_select at 0x7f4e6c05f040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1269171328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7fpKtJRBBQdSYoaZj6DP45DHfpF6JY6bphuYvNyWny2I0Jri+VAOdnp5HvVqESDZaqItJhrtYqxb+ZuOI53oPtKKrvxn879kPQDH7NsdOx8x6k82qXfHUrEyDOVnuDmg=="}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:23.709816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-ca5bf53e-2597-4367-af88-8e1ccbf1f5ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Getting quotas for project 3d9b727e705940c5bbdad32f9cb69087. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:23.713659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-ca5bf53e-2597-4367-af88-8e1ccbf1f5ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Getting quotas for user 565a25c59df84a1fa6f6420093e89fb4 and project 3d9b727e705940c5bbdad32f9cb69087. Resources: {'key_pairs'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:23.838773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ca5bf53e-2597-4367-af88-8e1ccbf1f5ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.412230 May 12 20:43:23.839390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 408/780] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 20:43:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:24.007361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:24.008069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:24.014407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.021472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.021472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.021472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.039859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lazy-loading 'flavor' on Instance uuid 280983fe-4f61-41a6-b6db-4cfa7ac32703 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:43:24.051528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:24.052139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:24.060825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.061301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.062246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.062683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.332515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:24.340777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28672d33-9d2e-4277-9109-bc4f9e04c50e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1361 microversion: 2.1 time: 0.293039 May 12 20:43:24.341469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 409/781] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:24.639455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4118506-c846-4db9-994b-e7882e7719b7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/action" status: 202 len: 0 microversion: 2.20 time: 0.638008 May 12 20:43:24.640201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 373/782] 10.222.0.59 () {62 vars in 1318 bytes} [Thu May 12 20:43:23 2022] POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 20:43:24.650739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:24.651355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:24.658687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.659137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.659913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:24.660336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:24.937113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:24.948031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:24.950987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:24.951347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-83c61a62-108a-4b8e-99e3-b43f26c79b17 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.306467 May 12 20:43:24.952057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 410/783] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:24 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:25.146056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081087457", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8378bf4-b568-4478-81bf-9948fffba758"}], "security_groups": [{"name": "tempest-securitygroup--1628730684"}], "key_name": "tempest-keypair-1448545032", "user_data": "}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:25.291169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] validate_networks() for [('e8378bf4-b568-4478-81bf-9948fffba758', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:43:25.358114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:25.358732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:25.364645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.365098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:25.365933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.367216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:25.597172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:25.608039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3f853272-fad1-41c8-bc04-f761e8a6a061 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1548 microversion: 2.1 time: 0.254304 May 12 20:43:25.608619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 411/784] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:25.627634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:25.628340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:25.636383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.637071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:25.638050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.638651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:25.761713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-31d29187-5c7f-4de7-b42f-be820b3eebe9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140236 May 12 20:43:25.762308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 412/785] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:43:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:25.973018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:25.974519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:25.989747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.990939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:25.992153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:25.992844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:26.043635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:43:26.044101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:43:26.045018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:43:26.046239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:43:26.053098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:43:26.073133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:26.073850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:26.074886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:26.075564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:26.095862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:26.100807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Getting quotas for user 606b53c6f60d45cf9e2c3e5c6c9cde2e and project bec19c8306c6439b9392248450d21ec9. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:26.114060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:43:26.117942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:43:26.282182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ca0accd-b7d1-41f2-9389-2c170322a791 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.150952 May 12 20:43:26.283879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 374/786] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:43:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 20:43:26.298641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-67b601ad-18fa-43fe-bdb7-4c7d80a58256 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:26.299274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-67b601ad-18fa-43fe-bdb7-4c7d80a58256 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:26.493736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-67b601ad-18fa-43fe-bdb7-4c7d80a58256 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:26.501817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-67b601ad-18fa-43fe-bdb7-4c7d80a58256 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1242 microversion: 2.1 time: 0.208623 May 12 20:43:26.506140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 375/787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:26 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1242 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:26.672495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:26.684498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:26.687256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:26.688962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e47dcdac-4df1-46e9-a513-3080d13fa01c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.721899 May 12 20:43:26.690361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 413/788] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:25 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:27.526521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:27.526987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:27.552345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:27.553045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:27.556139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:27.556468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:27.697891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:27.709441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-221632bd-7dd8-47fd-8ec2-b16eb4c3d37e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1246 microversion: 2.1 time: 0.191527 May 12 20:43:27.710974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 376/789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:27 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1246 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:27.719519 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:27.720406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:27.754914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:27.755960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:27.759548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:27.760461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:27.855823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-5e0e3e28-a9e7-41b6-8cad-cb7ddb6ae02c req-b9b3251c-2fe3-4398-a78e-25debcdfc950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5583a9e-213d-4250-afa6-8a77981ef335", "tag": "a86b8e9b-9010-40d0-a396-b8285e4fabfe"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:27.872003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5e0e3e28-a9e7-41b6-8cad-cb7ddb6ae02c req-b9b3251c-2fe3-4398-a78e-25debcdfc950 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:27.872320 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5e0e3e28-a9e7-41b6-8cad-cb7ddb6ae02c req-b9b3251c-2fe3-4398-a78e-25debcdfc950 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:27.899072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-5e0e3e28-a9e7-41b6-8cad-cb7ddb6ae02c req-b9b3251c-2fe3-4398-a78e-25debcdfc950 service nova] Creating event network-changed:a86b8e9b-9010-40d0-a396-b8285e4fabfe for instance c5583a9e-213d-4250-afa6-8a77981ef335 on hv-cinder-81565 May 12 20:43:27.919638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-5e0e3e28-a9e7-41b6-8cad-cb7ddb6ae02c req-b9b3251c-2fe3-4398-a78e-25debcdfc950 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364453 May 12 20:43:27.921944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 414/790] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:27.948658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:27.964265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:27.964265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:27.969305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4456db06-af85-4be3-958a-10cf1168e393 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.256941 May 12 20:43:27.969918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 377/791] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:27 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:28.731191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:28.732087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:28.738985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:28.739681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:28.750141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:28.750141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:28.836634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:28.844523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d489b336-8db6-45e8-94cf-ccc98dd21251 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1294 microversion: 2.1 time: 0.120983 May 12 20:43:28.855250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 415/792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:28 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:28.995080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:28.997027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:29.010981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:29.011473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:29.012189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:29.012559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:29.267826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:29.277092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:29.282920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:29.285993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d744f636-db0f-474d-a3ac-50ff4c4bc98f tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.301692 May 12 20:43:29.288361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 378/793] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:28 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:29.863309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:29.864001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:29.872524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:29.872918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:29.873739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:29.874500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:30.019316 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:30.028682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-60495842-28ee-4d46-a99e-97333724c5ec tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.170011 May 12 20:43:30.029301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 416/794] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:29 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:30.306723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:30.307492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:30.313947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:30.314406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:30.315173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:30.315648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:30.528529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:30.536432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:30.538549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:30.539719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-12067385-24ca-475a-b31a-56e87c2d7a61 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.237684 May 12 20:43:30.540277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 379/795] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:30 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:31.050182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:31.051172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:31.066032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:31.066521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:31.067513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:31.068140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:31.200685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-05555b01-ffb4-4df6-a51c-acb710bf54e2 req-8d13122b-40c4-48ee-b737-d3cf2ac148a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f740839-8a3c-4567-8b6f-9256a71e0115", "tag": "993d4c9a-8b2a-495e-982e-397e271acecb"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:31.210946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-05555b01-ffb4-4df6-a51c-acb710bf54e2 req-8d13122b-40c4-48ee-b737-d3cf2ac148a9 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:31.211582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-05555b01-ffb4-4df6-a51c-acb710bf54e2 req-8d13122b-40c4-48ee-b737-d3cf2ac148a9 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:31.228355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-05555b01-ffb4-4df6-a51c-acb710bf54e2 req-8d13122b-40c4-48ee-b737-d3cf2ac148a9 service nova] Creating event network-changed:993d4c9a-8b2a-495e-982e-397e271acecb for instance 6f740839-8a3c-4567-8b6f-9256a71e0115 on hv-cinder-81565 May 12 20:43:31.235143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-05555b01-ffb4-4df6-a51c-acb710bf54e2 req-8d13122b-40c4-48ee-b737-d3cf2ac148a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194386 May 12 20:43:31.237746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 417/796] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:31.333976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:31.342364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f2ed3860-33c7-4e9f-9083-7dc760b48e73 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.295844 May 12 20:43:31.342916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 380/797] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:31 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:31.558761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:31.559553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:31.566038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:31.566557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:31.567574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:31.569842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:31.719554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:31.729097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:31.730717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:31.731932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9dcfa4ad-1bda-4e67-b346-736f09b52a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.177716 May 12 20:43:31.732489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 418/798] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:31 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:32.359867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:32.360473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:32.367355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:32.367878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:32.368637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:32.369072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:32.500162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:32.507928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1fa6b928-5cc4-4f4c-a93a-85e6df9db25a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.151835 May 12 20:43:32.508505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 381/799] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:32 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:32.751466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:32.752078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:32.760614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:32.761185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:32.762353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:32.762884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:32.906938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:32.915724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:32.917327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:32.918518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-53d03a80-3056-406f-a780-03b1d17f1a55 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.171095 May 12 20:43:32.919076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 419/800] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:32 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:33.523972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:33.524578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:33.531625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:33.535454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:33.535454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:33.535454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:33.675434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:33.684350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-69e2c3b6-e56b-4d91-b637-3a31b271e06d tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.164251 May 12 20:43:33.684933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 382/801] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:33 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:33.937750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:33.938889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:33.946273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:33.946731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:33.947509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:33.947947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:34.089780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:34.100726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:34.102564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:34.103932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ef0a3d7a-fd84-4b08-bf47-4a8e84021e0b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.171249 May 12 20:43:34.104577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 420/802] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:33 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:34.701590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:34.710932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:34.710932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:34.710932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:34.710932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:34.711310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:34.856926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:34.864554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-47b6796b-c298-4932-bd87-15c58c940b64 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.166679 May 12 20:43:34.865115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 383/803] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:34 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:35.122115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:35.122820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:35.129198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:35.129688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:35.130458 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:35.131158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:35.275663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:35.283883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:35.285665 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:35.294899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-41ecdb0b-f182-47e3-a4c2-64b6c3d43671 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.169008 May 12 20:43:35.296100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 421/804] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:35 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:35.883657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:35.884917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:35.891458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:35.891923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:35.892726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:35.893168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:36.035704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:36.043692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4291eb07-31a6-4f6a-8677-8bf5519dea2b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.165277 May 12 20:43:36.044351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 384/805] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:35 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:36.317181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:36.317881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:36.324309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:36.324764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:36.325579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:36.326027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:36.459797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:36.472400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:36.472400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:36.472400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a8b729c0-bafe-4446-a368-2d4f5830b09a tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1745 microversion: 2.20 time: 0.158537 May 12 20:43:36.472971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 422/806] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:36 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:37.060699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:37.061338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:37.067655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:37.068099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:37.068907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:37.069299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:37.206545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:37.215360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99e7f8a9-358c-4732-89bd-8b8888c4205a tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.158538 May 12 20:43:37.215939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 385/807] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:37 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:37.492377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:37.493844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:37.501909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:37.502362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:37.503146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:37.503586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:37.701741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:37.709766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-b6e3d0d6-e5c0-48e3-be53-96ce6d1afb26 req-57039283-9c79-4aee-ad28-62bdf815be18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f740839-8a3c-4567-8b6f-9256a71e0115", "name": "network-vif-plugged", "status": "completed", "tag": "993d4c9a-8b2a-495e-982e-397e271acecb"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:37.710818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:37.712356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:37.714329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-399afdcf-ddea-4f1d-974e-3f02282855c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1745 microversion: 2.20 time: 0.225874 May 12 20:43:37.714887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 423/808] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:37 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:37.719330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-b6e3d0d6-e5c0-48e3-be53-96ce6d1afb26 req-57039283-9c79-4aee-ad28-62bdf815be18 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:37.719779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-b6e3d0d6-e5c0-48e3-be53-96ce6d1afb26 req-57039283-9c79-4aee-ad28-62bdf815be18 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:37.741570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-b6e3d0d6-e5c0-48e3-be53-96ce6d1afb26 req-57039283-9c79-4aee-ad28-62bdf815be18 service nova] Creating event network-vif-plugged:993d4c9a-8b2a-495e-982e-397e271acecb for instance 6f740839-8a3c-4567-8b6f-9256a71e0115 on hv-cinder-81565 May 12 20:43:37.747546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-b6e3d0d6-e5c0-48e3-be53-96ce6d1afb26 req-57039283-9c79-4aee-ad28-62bdf815be18 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224379 May 12 20:43:37.748479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 386/809] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:38.232646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:38.233464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:38.241842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:38.242491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:38.243532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:38.244156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:38.393490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:38.400850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c1ce8c9c-7250-447a-b652-0ccb885bf531 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.172781 May 12 20:43:38.411244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 424/810] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:38 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:38.734394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:38.735456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:38.751178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:38.751797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:38.757026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:38.757026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:38.942544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:38.952645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:38.954845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:38.956313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1b10a948-d23e-483a-a0b8-eaded044684b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.228048 May 12 20:43:38.957017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 387/811] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:38 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:39.418858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:39.420209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:39.435200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:39.436217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:39.439348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:39.441467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:39.615152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:39.624130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5e010c22-5d8d-4d2f-a8d9-7d02b9101d16 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1368 microversion: 2.1 time: 0.209701 May 12 20:43:39.629438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 425/812] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:39 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:39.769006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-d7abf970-4758-43e9-a986-23f88d50a48e req-c18beefb-5fa6-4650-8445-97e04eb33855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "name": "network-vif-plugged", "status": "completed", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:39.797008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-d7abf970-4758-43e9-a986-23f88d50a48e req-c18beefb-5fa6-4650-8445-97e04eb33855 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:39.797008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-d7abf970-4758-43e9-a986-23f88d50a48e req-c18beefb-5fa6-4650-8445-97e04eb33855 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:39.812885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-d7abf970-4758-43e9-a986-23f88d50a48e req-c18beefb-5fa6-4650-8445-97e04eb33855 service nova] Creating event network-vif-plugged:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:43:39.819127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-d7abf970-4758-43e9-a986-23f88d50a48e req-c18beefb-5fa6-4650-8445-97e04eb33855 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057705 May 12 20:43:39.820397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 388/813] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:39.976297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:39.976911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:39.986980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:39.987727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:39.988522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:39.988960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:40.151717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:40.161857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:40.163425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:40.164772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d90aec6b-7334-40c6-88d8-801f8d3a7bd3 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.192755 May 12 20:43:40.165347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 426/814] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:39 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:40.642409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:40.643564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:40.650394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:40.651702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:40.652736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:40.653486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:40.824362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:40.832825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cdf60228-e095-4cf8-84e1-c51b36536527 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1559 microversion: 2.1 time: 0.194655 May 12 20:43:40.834312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 389/815] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:40 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:40.863074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:40.866232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:40.876198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:40.876796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:40.877729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:40.878395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:40.974310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4898c76d-ee71-4033-b33a-2ead2234322c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120005 May 12 20:43:40.975093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 427/816] 10.222.0.59 () {58 vars in 1274 bytes} [Thu May 12 20:43:40 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:41.184164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:41.185083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:41.191744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:41.192480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:41.193484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:41.194100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:41.725055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:41.736989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:41.738716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:41.739942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2a4fc62f-254e-45aa-847f-6c778f7fe5db tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.559925 May 12 20:43:41.740508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 390/817] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:41 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:42.724778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-3d529460-fec4-4b8c-b5da-4110d646b9cd req-cd265230-f9dc-4224-a8dd-3d753348bbdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f740839-8a3c-4567-8b6f-9256a71e0115", "tag": "993d4c9a-8b2a-495e-982e-397e271acecb"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:42.733387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3d529460-fec4-4b8c-b5da-4110d646b9cd req-cd265230-f9dc-4224-a8dd-3d753348bbdb service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:42.743403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-3d529460-fec4-4b8c-b5da-4110d646b9cd req-cd265230-f9dc-4224-a8dd-3d753348bbdb service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:42.746054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-3d529460-fec4-4b8c-b5da-4110d646b9cd req-cd265230-f9dc-4224-a8dd-3d753348bbdb service nova] Creating event network-changed:993d4c9a-8b2a-495e-982e-397e271acecb for instance 6f740839-8a3c-4567-8b6f-9256a71e0115 on hv-cinder-81565 May 12 20:43:42.751415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-3d529460-fec4-4b8c-b5da-4110d646b9cd req-cd265230-f9dc-4224-a8dd-3d753348bbdb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030771 May 12 20:43:42.752739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 428/818] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:42.763032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:42.763643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:42.776687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:42.777950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:42.778933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:42.779913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:43.297925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:43.310524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:43.318609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:43.320895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-162ddb9b-b3d3-4f3a-8792-ab73263065cf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.565129 May 12 20:43:43.335928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 391/819] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:42 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:44.022257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1559670070", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1269171328", "security_groups": [{"name": "tempest-secgroup-smoke-1515757400"}], "networks": [{"uuid": "e07b0c2a-3b0b-427d-8e88-ae647b0b2794"}], "block_device_mapping_v2": [{"uuid": "c15718b3-a301-406e-aa28-df0444e886aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:44.192798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] validate_networks() for [('e07b0c2a-3b0b-427d-8e88-ae647b0b2794', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:43:44.344772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:44.346485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:44.356106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:44.356893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:44.358102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:44.358763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:44.559311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:44.571644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:44.586427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:44.586427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3ab4aa44-83cb-4030-b126-ce9a1f8e5833 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.238135 May 12 20:43:44.586427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 392/820] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:44 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:44.897260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:43:44.897814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:43:44.898369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:43:44.898907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:43:44.899392 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:43:44.909795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:44.910801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:44.911695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:44.912143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:44.937541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Getting quotas for project 3d9b727e705940c5bbdad32f9cb69087. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:44.941694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Getting quotas for user 565a25c59df84a1fa6f6420093e89fb4 and project 3d9b727e705940c5bbdad32f9cb69087. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:45.007729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:43:45.010038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c15718b3-a301-406e-aa28-df0444e886aa',volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:43:45.219749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-787300683", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "networks": [{"uuid": "2668676a-64e2-42de-88a8-b3b6f4a5bc09"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:45.281569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] validate_networks() for [('2668676a-64e2-42de-88a8-b3b6f4a5bc09', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 20:43:45.528691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-710a49ea-b7d1-4e6d-a29d-a776808a9403 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.521859 May 12 20:43:45.534419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 429/821] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:43:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 20:43:45.539506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-001ff7fd-f52d-4fe4-a22c-650bc41079d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:45.540123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-001ff7fd-f52d-4fe4-a22c-650bc41079d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:45.599528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-001ff7fd-f52d-4fe4-a22c-650bc41079d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:45.607407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-001ff7fd-f52d-4fe4-a22c-650bc41079d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1089 microversion: 2.1 time: 0.071695 May 12 20:43:45.608366 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 430/822] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:45.615820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:45.616657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:45.624525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:45.625108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:45.625936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:45.626464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:45.722890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 20:43:45.723566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 20:43:45.723794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 20:43:45.724222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 20:43:45.724659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 20:43:45.736492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:45.736944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:45.737800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:45.738236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:45.755747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Getting quotas for project fd3f403a1bdf48db8bec832b39b8f391. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 20:43:45.771246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Getting quotas for user b4df001beaca4de2a8e15c26b31a9168 and project fd3f403a1bdf48db8bec832b39b8f391. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 20:43:45.771875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 20:43:45.774238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 20:43:45.790618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:45.799492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:45.801657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:45.802680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6f9be89b-55f5-485c-9125-7be8d5cc30b9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.193295 May 12 20:43:45.803251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 431/823] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:45 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:46.039745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e31b60a4-23eb-4792-8c98-47bdd1417c42 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824165 May 12 20:43:46.040395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 393/824] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 20:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 20:43:46.051096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-79de6cdd-f107-4fa9-b91e-e656bf2f210d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:46.051828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-79de6cdd-f107-4fa9-b91e-e656bf2f210d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:46.107807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79de6cdd-f107-4fa9-b91e-e656bf2f210d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:46.115493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-79de6cdd-f107-4fa9-b91e-e656bf2f210d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1218 microversion: 2.1 time: 0.067207 May 12 20:43:46.115493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 432/825] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:46.626682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-20e84fd2-4a04-4cc5-b59c-6e3039822339 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:46.627305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-20e84fd2-4a04-4cc5-b59c-6e3039822339 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:46.708323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-20e84fd2-4a04-4cc5-b59c-6e3039822339 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:46.708323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-20e84fd2-4a04-4cc5-b59c-6e3039822339 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1089 microversion: 2.1 time: 0.084977 May 12 20:43:46.713734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 394/826] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1089 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:46.821841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:46.824032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:46.833574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:46.834272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:46.835300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:46.835742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:46.995032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:47.003296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:47.006735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:47.008203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b71efbc3-d27d-4202-a005-81f321715e98 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.190312 May 12 20:43:47.008933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 433/827] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:46 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:47.133118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3a45f09b-6436-43a2-a549-c26aa2912b86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:47.136402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3a45f09b-6436-43a2-a549-c26aa2912b86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:47.206197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3a45f09b-6436-43a2-a549-c26aa2912b86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:47.214313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3a45f09b-6436-43a2-a549-c26aa2912b86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1218 microversion: 2.1 time: 0.086570 May 12 20:43:47.215443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 395/828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:47 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:47.730950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:47.732108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:47.743584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:47.745920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:47.747454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:47.748103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:47.820278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:47.827674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-92eb8dbd-3fc7-43fd-8377-c6eaf6e2a9ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1187 microversion: 2.1 time: 0.103161 May 12 20:43:47.828947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 434/829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:48.026563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:48.027576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:48.039769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.040890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.052284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.052284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.235034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:48.236047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:48.243814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.246050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.248158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.248655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.258009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:48.268363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:48.273349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:48.288227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1bd83eca-58af-425e-a689-1fd73bd34eaf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.253855 May 12 20:43:48.288735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 396/830] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:48 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:48.320106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:48.329591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-836b35c3-aaeb-42a9-a55c-83b1d3bf4fa3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1270 microversion: 2.1 time: 0.100265 May 12 20:43:48.340053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 435/831] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:48.844720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:48.845831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:48.854965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.857334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.857334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:48.857831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:48.950306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:48.959908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fa0e766e-4096-4c17-b334-11a5260707a1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1205 microversion: 2.1 time: 0.119130 May 12 20:43:48.960763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 397/832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:49.296435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:49.297027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:49.303277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.303718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:49.304482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.304913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:49.347668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:49.348541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:49.355645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.356112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:49.356871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.357327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:49.435406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:49.441690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:49.442926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-39a80b2f-d183-48f1-a38a-70f119bdce64 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1278 microversion: 2.1 time: 0.099090 May 12 20:43:49.443538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 398/833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:49 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:49.452942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:49.454472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:49.455630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b19833e7-8893-4348-a09f-e382a85a57a1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.163478 May 12 20:43:49.456181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 436/834] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:49 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:49.977103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:49.977944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:49.994595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.997962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:49.999066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:49.999680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:50.304822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:50.313777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b892eb71-72bf-4b77-ae13-9bbecd5a10c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1273 microversion: 2.1 time: 0.340644 May 12 20:43:50.314543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 399/835] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:50.462505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:50.464443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:50.491840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:50.491840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:50.491840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:50.491840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:50.492663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:50.492663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:50.492846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:50.492846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:50.492846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:50.492846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:50.722183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:50.731437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2776b33a-5ce7-4bf4-b64b-b69ce201dc58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.273555 May 12 20:43:50.732526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 437/836] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:50.763793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:50.776536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:50.778245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:50.781886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-09fc8b57-f8b9-44a8-bf86-a70a45e28f41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1740 microversion: 2.20 time: 0.309188 May 12 20:43:50.785004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 400/837] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:50 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:51.330830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:51.332043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:51.333358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-fd81fb00-7cf4-4378-8a55-ceae99597fee req-ce5dac61-b6e8-4789-97ce-63ad7eb7aea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ab3d9c-d609-4b71-98bf-2b56f872645d", "tag": "ead1f063-0b06-48b1-bb92-fb802fd50e6a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:51.338071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.338633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.340102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.340102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.343212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fd81fb00-7cf4-4378-8a55-ceae99597fee req-ce5dac61-b6e8-4789-97ce-63ad7eb7aea6 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.343895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fd81fb00-7cf4-4378-8a55-ceae99597fee req-ce5dac61-b6e8-4789-97ce-63ad7eb7aea6 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.364787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-fd81fb00-7cf4-4378-8a55-ceae99597fee req-ce5dac61-b6e8-4789-97ce-63ad7eb7aea6 service nova] Creating event network-changed:ead1f063-0b06-48b1-bb92-fb802fd50e6a for instance 10ab3d9c-d609-4b71-98bf-2b56f872645d on hv-cinder-81565 May 12 20:43:51.389900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-fd81fb00-7cf4-4378-8a55-ceae99597fee req-ce5dac61-b6e8-4789-97ce-63ad7eb7aea6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041437 May 12 20:43:51.389900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 401/838] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:51.541465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:51.549537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4429c8bf-16db-43a8-8311-2324bcba0f29 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.222549 May 12 20:43:51.555274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 438/839] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:51.729206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-92cca835-0119-42ae-a542-f8e68f26b0e0 req-ce948120-2e53-4770-b772-2df9c1db0e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:51.740314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-92cca835-0119-42ae-a542-f8e68f26b0e0 req-ce948120-2e53-4770-b772-2df9c1db0e97 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.740803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-92cca835-0119-42ae-a542-f8e68f26b0e0 req-ce948120-2e53-4770-b772-2df9c1db0e97 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.752891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:51.755574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:51.759388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-92cca835-0119-42ae-a542-f8e68f26b0e0 req-ce948120-2e53-4770-b772-2df9c1db0e97 service nova] Creating event network-changed:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:43:51.763335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.764095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.765121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.765925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.777439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-92cca835-0119-42ae-a542-f8e68f26b0e0 req-ce948120-2e53-4770-b772-2df9c1db0e97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053120 May 12 20:43:51.778041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 402/840] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:51.798968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:51.799614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:51.813805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.814702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:51.815748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:51.816372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:52.064265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:52.074267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f972eb12-5449-489c-b316-e0c67655bfb0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.327551 May 12 20:43:52.075263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 439/841] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:52.135910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:52.144425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:52.146186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:52.147432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cd10d1ee-f955-4383-bcbf-08893e713ba5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1722 microversion: 2.20 time: 0.353287 May 12 20:43:52.147918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 403/842] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:51 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:52.567000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:52.567554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:52.575168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:52.575651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:52.580372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:52.580372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:52.704490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:52.711793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8cd78af4-3611-4d28-ab16-3347fb9683ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.148793 May 12 20:43:52.712362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 440/843] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:53.092852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:53.093503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:53.099424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.099880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.100644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.101079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.167931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:53.168464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:53.174371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.174826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.175596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.176037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.262159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:53.269576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7e5a9d2e-f59e-462e-ba84-6cbcc392c1f4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.181607 May 12 20:43:53.270363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 404/844] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:53.309874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:53.317542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:53.319031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:53.320177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0b561d45-bd9f-4952-86b9-dfad920362d9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1722 microversion: 2.20 time: 0.156687 May 12 20:43:53.320739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 441/845] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:53 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:53.729069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:53.729678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:53.735636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.736079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.736833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:53.737281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:53.870774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:53.878008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-17f3537f-4bcd-4e49-9bb5-d95ca40616ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.153625 May 12 20:43:53.878583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 405/846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:54.286766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:54.287399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:54.293674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.294121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:54.294958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.295388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:54.339532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:54.340134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:54.346365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.346809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:54.347651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.348079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:54.421720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:54.429094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7146ffac-5b00-4897-94ce-911fbe5369ca tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.146105 May 12 20:43:54.429687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 442/847] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:54.477644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:54.485694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:54.487190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:54.488338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4a94df84-6502-463c-b906-c8241a35c0c9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1722 microversion: 2.20 time: 0.153338 May 12 20:43:54.488899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 406/848] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:54 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:54.895288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:54.895891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:54.902697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.903143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:54.904024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:54.904463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.039278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:55.049475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1f78c93d-2a15-438e-a04d-fee045b16ff1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.158132 May 12 20:43:55.050059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 443/849] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:55.446607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:55.447231 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:55.454792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.455205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.455987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.456431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.490505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-ec9e4039-a506-4ba6-aede-3cab29ee13a5 req-7cec45ec-61c5-4319-ae6e-5baf6ce878cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "name": "network-vif-unplugged", "status": "completed", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:55.504104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-ec9e4039-a506-4ba6-aede-3cab29ee13a5 req-7cec45ec-61c5-4319-ae6e-5baf6ce878cf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.504104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-ec9e4039-a506-4ba6-aede-3cab29ee13a5 req-7cec45ec-61c5-4319-ae6e-5baf6ce878cf service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.514939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-ec9e4039-a506-4ba6-aede-3cab29ee13a5 req-7cec45ec-61c5-4319-ae6e-5baf6ce878cf service nova] Creating event network-vif-unplugged:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:43:55.520727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-ec9e4039-a506-4ba6-aede-3cab29ee13a5 req-7cec45ec-61c5-4319-ae6e-5baf6ce878cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033948 May 12 20:43:55.521564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 444/850] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:43:55.527905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:55.528847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:55.535289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.536031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.537006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.537829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.637086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:55.647260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-970d9fb4-9db7-418f-89ba-470f35965f0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.204432 May 12 20:43:55.657454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 407/851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:55.678010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:55.686732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:55.688355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:55.689567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d09fd9e2-453e-43cd-8f6e-c1767f2436be tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1725 microversion: 2.20 time: 0.166606 May 12 20:43:55.690130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 445/852] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:55 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:55.708281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b7f981f-8a48-4320-b456-8cac1bed1196"}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:55.709427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:55.716744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.717194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:55.717997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:55.718434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.066902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:56.067429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:56.073330 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.073821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.074834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.075347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.208091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:56.216714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5c825f9b-5556-422e-9cbe-829e6a6ff10b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.153723 May 12 20:43:56.217338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 446/853] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:56.625521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd7496a4-6ced-4e8b-a48f-07a62241d895 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.921061 May 12 20:43:56.626093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 408/854] 10.222.0.59 () {62 vars in 1363 bytes} [Thu May 12 20:43:55 2022] POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments => generated 188 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 20:43:56.665062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:56.666216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:56.673668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.674125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.674892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.675337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.756952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:56.757784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:56.765958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.766477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.767321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:56.767861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:56.818493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:56.826687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4384a4e5-9578-45fb-aa1b-975dbaf5f74f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.165588 May 12 20:43:56.827258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 447/855] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:57.233587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:57.234195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:57.240000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.240445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.241194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.241655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.376479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:57.383890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0477c18f-f72b-4ee5-8bf2-619cd64cdeed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.154830 May 12 20:43:57.389106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 448/856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:43:57.389252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-716e2630-40b0-44dd-92ac-87b961041bd5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments/9b7f981f-8a48-4320-b456-8cac1bed1196" status: 202 len: 0 microversion: 2.20 time: 0.634356 May 12 20:43:57.389252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 409/857] 10.222.0.59 () {60 vars in 1456 bytes} [Thu May 12 20:43:56 2022] DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments/9b7f981f-8a48-4320-b456-8cac1bed1196 => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 20:43:57.445710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:57.446425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:57.453349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.453799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.454571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.455007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.555699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-613ecf23-59cb-44d0-982a-4e027c09b55b req-27150bdc-78e5-4244-bb90-aeb633e69229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab3d9c-d609-4b71-98bf-2b56f872645d", "name": "network-vif-plugged", "status": "completed", "tag": "ead1f063-0b06-48b1-bb92-fb802fd50e6a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:43:57.565533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-613ecf23-59cb-44d0-982a-4e027c09b55b req-27150bdc-78e5-4244-bb90-aeb633e69229 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.565960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-613ecf23-59cb-44d0-982a-4e027c09b55b req-27150bdc-78e5-4244-bb90-aeb633e69229 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.576914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-613ecf23-59cb-44d0-982a-4e027c09b55b req-27150bdc-78e5-4244-bb90-aeb633e69229 service nova] Creating event network-vif-plugged:ead1f063-0b06-48b1-bb92-fb802fd50e6a for instance 10ab3d9c-d609-4b71-98bf-2b56f872645d on hv-cinder-81565 May 12 20:43:57.581648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-613ecf23-59cb-44d0-982a-4e027c09b55b req-27150bdc-78e5-4244-bb90-aeb633e69229 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029649 May 12 20:43:57.582241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 410/858] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:43:57.653877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4cf4f31d-2f1c-4e4c-bbb9-243272597371 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/action" status: 202 len: 0 microversion: 2.20 time: 0.212141 May 12 20:43:57.654680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 449/859] 10.222.0.59 () {62 vars in 1318 bytes} [Thu May 12 20:43:57 2022] POST /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 20:43:57.663150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:57.663848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:57.670406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.670867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.671727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.672484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.814557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:57.822489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:57.827336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:57.827336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d87c5614-e639-4621-8865-35656799fd5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1673 microversion: 2.20 time: 0.167438 May 12 20:43:57.827666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 411/860] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:57 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:43:57.843367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:57.843984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:57.850361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.850814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.851584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:57.852021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:57.994881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:58.002581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7c009b21-1947-415f-88c9-bed5dc5ddd01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.163977 May 12 20:43:58.003154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 450/861] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:58.401002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:58.401651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:58.408321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:58.408834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:58.409629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:58.410070 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:58.546843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:58.554281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4d73eafa-9bef-442f-b470-d59ce38ec636 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.157124 May 12 20:43:58.554843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 412/862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:58.845031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:58.845685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:58.852126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:58.852581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:58.853383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:58.853824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:58.990668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:58.999443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:59.000924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:59.002122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e4e4620e-898d-44ce-8f57-0d8967eb03a5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1673 microversion: 2.20 time: 0.161110 May 12 20:43:59.002675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 451/863] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:43:58 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:43:59.019686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:59.020293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:59.026498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:59.027487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:59.028749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:59.029188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:59.157127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:59.164347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-246b9c78-fc64-4cc5-b947-8c53239edbf1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1318 microversion: 2.1 time: 0.148439 May 12 20:43:59.164923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 413/864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:43:59.571064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:43:59.571683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:43:59.578379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:59.578840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:59.579619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:43:59.580050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:43:59.711478 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:43:59.718941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a4da7db-f25c-4727-95a7-00a5c55c80e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.151754 May 12 20:43:59.719860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 452/865] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:43:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:00.021613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:00.022173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:00.029164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.029645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.030417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.030861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.181245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:00.182016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:00.188696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.189155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.190016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.190496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.224594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:00.234314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:00.236065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:00.237437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-36175c51-0583-423e-a397-aca6af753adf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.219841 May 12 20:44:00.238306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 414/866] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:00 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:00.325069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:00.332477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a5eb2864-5d43-46f1-9e85-5c0a820c95f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1507 microversion: 2.1 time: 0.155131 May 12 20:44:00.333042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 453/867] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:00 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:44:00.735658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:00.736301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:00.742244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.742700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.743466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:00.743910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:00.883496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:00.890999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aa6ed57e-dff6-467a-8733-1c3123fa8739 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.159133 May 12 20:44:00.891578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 415/868] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:01.258218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:01.259654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:01.265354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:01.265815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:01.266627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:01.267022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:01.395713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:01.405586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:01.407126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:01.408405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6ecf3f79-3a7f-4076-8766-86fad9078744 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.154323 May 12 20:44:01.409169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 454/869] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:01 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:01.907586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:01.908204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:01.914642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:01.915099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:01.915874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:01.916306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:02.293694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:02.307523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df551ae8-72c8-4fd3-85d0-b4709e410532 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.402933 May 12 20:44:02.309490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 416/870] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:02.428571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:02.429117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:02.439512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:02.439971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:02.440768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:02.441209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:02.608343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:02.616820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:02.618559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:02.619718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-284bf005-0b22-4484-95b5-7fc91596f1d8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.195715 May 12 20:44:02.620275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 455/871] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:02 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:03.325319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:03.326920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:03.333604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:03.334389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:03.335420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:03.335923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:03.507130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:03.519304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1977876d-9524-46e7-a90b-3c0bf47b3161 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.197800 May 12 20:44:03.520212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 417/872] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:03.639371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:03.640115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:03.647116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:03.647791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:03.649117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:03.649742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:03.802044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:03.810518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:03.812069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:03.813236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a3d635e0-0fe0-4cc7-929e-49cd754affd4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.178139 May 12 20:44:03.813875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 456/873] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:03 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:04.537098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:04.537687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:04.544377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.544828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:04.545641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.546151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:04.588087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:04.588936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:04.597420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.597959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:04.598854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.599354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:04.638930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd76d830-fa5e-40cc-aba7-6a135ca26cf3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/ips" status: 200 len: 146 microversion: 2.1 time: 0.055071 May 12 20:44:04.639815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 457/874] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:44:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:44:04.708570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:04.717104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c3a8c462-347e-48ea-a2ee-a130b8e299e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.183779 May 12 20:44:04.718006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 418/875] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:04.834085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:04.835257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:04.844349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.844894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:04.845826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:04.847838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:05.006796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:05.025173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:05.027273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:05.028600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3140f34e-5f2b-4fd4-a3fd-0fc5479c423d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.200083 May 12 20:44:05.029242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 458/876] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:04 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:05.602839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-2fc1794f-e3e9-4dd7-83c7-71f72359f254 req-0aa2090c-4747-4b9b-976c-155d8785d92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "name": "network-vif-plugged", "status": "completed", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:05.616474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2fc1794f-e3e9-4dd7-83c7-71f72359f254 req-0aa2090c-4747-4b9b-976c-155d8785d92c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:05.616474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-2fc1794f-e3e9-4dd7-83c7-71f72359f254 req-0aa2090c-4747-4b9b-976c-155d8785d92c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:05.634353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-2fc1794f-e3e9-4dd7-83c7-71f72359f254 req-0aa2090c-4747-4b9b-976c-155d8785d92c service nova] Creating event network-vif-plugged:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:44:05.640033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-2fc1794f-e3e9-4dd7-83c7-71f72359f254 req-0aa2090c-4747-4b9b-976c-155d8785d92c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040737 May 12 20:44:05.643589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 419/877] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:05.740727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:05.741664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:05.748908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:05.749721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:05.750564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:05.751177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:05.921023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:05.928884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-238b57d8-27ae-42ed-bbfe-cacd6ad6b23e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.198310 May 12 20:44:05.931963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 459/878] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:06.048494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:06.049119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:06.056520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.056944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:06.057759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.058195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:06.219105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:06.227550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:06.229193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:06.230476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a2f6191b-0584-42f7-8d83-bd287d89a551 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.187377 May 12 20:44:06.231237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 420/879] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:06 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:06.628864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d2c61c-0713-4a12-b11d-b8c8b092dde2"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:06.630041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:06.636736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.637513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:06.638432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.639125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:06.947492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:06.948352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:06.956135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.956638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:06.957475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:06.957917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:07.112098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:07.123953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af4b5846-411e-4f7e-9567-02256be15c6b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.180240 May 12 20:44:07.133803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 421/880] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:44:07.251264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:07.251869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:07.258203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:07.258653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:07.259424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:07.259867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:07.423156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:07.433835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:07.436125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:07.437413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0f42f88c-3147-493c-8f16-08b0d3c61719 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.190681 May 12 20:44:07.445796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 422/881] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:07 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:08.142254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:08.144169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:08.151981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:08.152530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:08.153449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:08.154032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:08.313263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:08.322410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ab10261c-6734-46b2-831b-aee1ffea63b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.185695 May 12 20:44:08.331250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 423/882] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:44:08.456179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:08.456825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:08.462990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:08.470597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:08.470597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:08.470597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:08.616872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:08.626818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:08.628524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:08.629734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f038aa34-92b2-4fe0-9176-6d1051ef37ca tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.177485 May 12 20:44:08.630475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 424/883] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:08 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:09.342711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:09.343442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:09.349991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:09.350446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:09.351219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:09.351661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:09.514324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:09.523405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd0c3b2f-af9a-49af-860e-fa88ec8bfc5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.185662 May 12 20:44:09.533415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 425/884] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:44:09.648288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:09.648819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:09.656058 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:09.656511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:09.657483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:09.657925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:09.806188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:09.820045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:09.821638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:09.823100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-82547e5a-f479-48b2-b8e2-b7d88d96b4c8 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.178704 May 12 20:44:09.823981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 426/885] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:09 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:10.543831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:10.544536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:10.559903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:10.560852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:10.561204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:10.561701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:10.718210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:10.727018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6a3ed7f8-afd3-40f4-99b8-486b23fd127a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.187803 May 12 20:44:10.727923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 427/886] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:44:10.842599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:10.843205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:10.849384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:10.849834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:10.850602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:10.851036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:11.010847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:11.018946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:11.020596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:11.021988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2a52652d-a8e6-40c3-9f7b-1f2dad44bd68 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.183255 May 12 20:44:11.024504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 428/887] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:10 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:11.744382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:11.745123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:11.751866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:11.752451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:11.753292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:11.753738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:11.887338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:11.896432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-57501bde-a779-496d-bf55-287155eb6ddd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.155331 May 12 20:44:11.896432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 429/888] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:12.040555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:12.041204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:12.048057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:12.048719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:12.049522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:12.049958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:12.189335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:12.199216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:12.201079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:12.202602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-185e1116-7115-4c52-9a07-3334a070157c tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.166123 May 12 20:44:12.203212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 430/889] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:12 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:12.914605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:12.915261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:12.921948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:12.922404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:12.923207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:12.923649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:13.063436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:13.071150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-221f40b1-e363-4561-8b68-d7785b0a3677 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.160445 May 12 20:44:13.071725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 431/890] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:13.221754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:13.222347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:13.228053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:13.228501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:13.229296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:13.229801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:13.359647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:13.367693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:13.369207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:13.370433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-91d76c28-dd55-45c5-9f1b-952dada0a2f7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.152915 May 12 20:44:13.371822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 432/891] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:13 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:13.595811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2ebd203f-9e85-4afd-9a45-a51341eb9317 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.971241 May 12 20:44:13.601702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 460/892] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:44:06 2022] POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 194 bytes in 6973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:14.089217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:14.089850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:14.096856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:14.097332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:14.098093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:14.098524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:14.227699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:14.235922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7b420914-7c29-4a38-9f21-b7a04fcce43d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.150549 May 12 20:44:14.236480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 433/893] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:14.390608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:14.391300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:14.397520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:14.397968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:14.398731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:14.399166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:14.528608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:14.536292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:14.537844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:14.544361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ba42824f-9d0f-4ea0-96cc-5e0a17486cbe tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.153570 May 12 20:44:14.544361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 461/894] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:14 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:15.252646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:15.253191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:15.259791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:15.260246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:15.261010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:15.261479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:15.393794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:15.401368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f56675b5-ad52-414d-833f-155efd0209d1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1261 microversion: 2.1 time: 0.152637 May 12 20:44:15.402372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 434/895] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:15.557612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:15.558842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:15.565992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:15.566447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:15.567347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:15.567818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:15.704017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:15.712624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:15.714193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:15.715448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e124632d-c9d1-4cd4-a588-2b085f0534b4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.161689 May 12 20:44:15.716074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 462/896] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:15 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:16.418371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:16.419699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:16.426178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.426631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.427408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.427850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.560311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:16.568061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bafefb4d-1e0c-4360-84bf-19a96bc772ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1445 microversion: 2.1 time: 0.153481 May 12 20:44:16.570699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 435/897] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:16.586955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:16.587576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:16.596659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.597117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.597929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.598373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.734592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:16.734969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:16.735588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:16.741362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.741813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.742032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-373b95bd-4754-45f8-afa0-b7b5b8bdc9fa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1445 microversion: 2.1 time: 0.160073 May 12 20:44:16.742608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 463/898] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:44:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:44:16.742777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:16.743034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:16.885614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:16.893983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:16.895489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:16.896648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f6ad5b76-20d1-441a-93e7-1938033660c6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.166506 May 12 20:44:16.897202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 436/899] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:16 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:17.573401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-5565e959-7bea-498b-a49f-e8ea4c487380 req-0f1ae447-80fc-4209-afbc-112a97ec781e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "name": "network-vif-plugged", "status": "completed", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:17.582517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5565e959-7bea-498b-a49f-e8ea4c487380 req-0f1ae447-80fc-4209-afbc-112a97ec781e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:17.582964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-5565e959-7bea-498b-a49f-e8ea4c487380 req-0f1ae447-80fc-4209-afbc-112a97ec781e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:17.594736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-5565e959-7bea-498b-a49f-e8ea4c487380 req-0f1ae447-80fc-4209-afbc-112a97ec781e service nova] Creating event network-vif-plugged:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:44:17.599473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-5565e959-7bea-498b-a49f-e8ea4c487380 req-0f1ae447-80fc-4209-afbc-112a97ec781e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029859 May 12 20:44:17.600045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 464/900] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:17.924550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:17.925188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:17.930065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac664be6-91bb-4dba-813c-78b8f0936c93", "device": "/dev/sdb"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:17.931658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:17.932878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:17.933531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:17.934443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:17.939650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:17.940109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:17.940890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:17.941346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:17.944425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:18.123791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:18.131827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:18.133388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:18.134551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-288bcf4c-2453-478c-ac1f-ba2cf2faed59 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.223474 May 12 20:44:18.135104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 437/901] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:17 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:18.879468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a0a4cd9-8497-470e-a005-6b42b9b520c3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "POST /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954891 May 12 20:44:18.886442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 465/902] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:44:17 2022] POST /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:19.154197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:19.154802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:19.161828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:19.162276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:19.163163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:19.163585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:19.301050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-9289bb3e-d518-478f-ba03-2a3282b054de req-7367e30e-458c-4b27-a084-0135a84c42e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:19.310511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-9289bb3e-d518-478f-ba03-2a3282b054de req-7367e30e-458c-4b27-a084-0135a84c42e4 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:19.310964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-9289bb3e-d518-478f-ba03-2a3282b054de req-7367e30e-458c-4b27-a084-0135a84c42e4 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:19.323880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-9289bb3e-d518-478f-ba03-2a3282b054de req-7367e30e-458c-4b27-a084-0135a84c42e4 service nova] Creating event network-changed:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:44:19.330393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-9289bb3e-d518-478f-ba03-2a3282b054de req-7367e30e-458c-4b27-a084-0135a84c42e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033283 May 12 20:44:19.330981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 466/903] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:44:19.343313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:19.352507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:19.354024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:19.355310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af39c7e2-2d4b-43db-9864-bc4d80804c41 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.205163 May 12 20:44:19.355890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 438/904] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:19 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:44:20.375062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:20.375748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:20.382416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:20.386754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:20.386754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:20.386754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:20.515583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:20.527589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:20.529192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:20.530523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4e3b653c-c289-43c6-88d4-7e2812928c64 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1731 microversion: 2.20 time: 0.160573 May 12 20:44:20.531291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 467/905] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:20 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:21.548782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:21.549413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:21.556105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:21.556555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:21.558118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:21.558749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:21.690285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:21.698143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:21.699640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:44:21.700800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ab4004f4-2bdf-4172-a13c-573d7d88cdf0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1718 microversion: 2.20 time: 0.156775 May 12 20:44:21.701372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 439/906] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:44:21 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:44:22.218526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:22.219541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:22.225844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:22.226298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:22.227063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:22.227498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:22.257150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0da8a022-e14c-4572-b678-70b72376b5b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042522 May 12 20:44:22.257719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 468/907] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:44:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:22.267490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:22.267988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:22.274042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:22.274495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:22.275267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:22.275703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:22.303622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7378576f-77eb-40e5-94f6-c1e473e4bbdc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2" status: 200 len: 194 microversion: 2.1 time: 0.040086 May 12 20:44:22.304194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 440/908] 10.222.0.59 () {58 vars in 1412 bytes} [Thu May 12 20:44:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:23.981807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2c7843a-fd65-4f95-b0c0-20e9c77334c2"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:23.982872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:23.990156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:23.990613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:23.991379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:23.991977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:24.668904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bf0bf11f-efd6-45bb-b026-5fac4378d885 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691339 May 12 20:44:24.669866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 469/909] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:44:23 2022] POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:44:26.884499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:26.884994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:26.891364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:26.891813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:26.892577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:26.893093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:26.915839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fa804289-fbff-46ff-b1dc-09d664b12f83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/ips" status: 200 len: 151 microversion: 2.1 time: 0.035611 May 12 20:44:26.916394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 441/910] 10.222.0.59 () {58 vars in 1247 bytes} [Thu May 12 20:44:26 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:28.555596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8fbbcee-88b1-4978-9eab-2ee121569274"}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:44:28.556767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:28.564250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:28.564708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:28.565523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:28.566079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:29.360801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8a60af41-3f4f-4ce7-b95f-b4ca35e8ec75 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "POST /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810303 May 12 20:44:29.361519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 470/911] 10.222.0.59 () {60 vars in 1322 bytes} [Thu May 12 20:44:28 2022] POST /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:44:59.964313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:44:59.965256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:44:59.971173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:59.971624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:44:59.972377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:44:59.972926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:00.000706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c6d53ed-1146-4ff9-a23c-1c0069a0f1bf tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040605 May 12 20:45:00.001288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 442/912] 10.222.0.59 () {60 vars in 1342 bytes} [Thu May 12 20:44:59 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:45:00.059693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:00.060313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:00.067120 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:00.067571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:00.068347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:00.068790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:00.095736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:45:00.333195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1b2ceef8-fd47-418f-b2d4-bd5029103b5b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 204 len: 0 microversion: 2.20 time: 0.277967 May 12 20:45:00.335756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 471/913] 10.222.0.59 () {60 vars in 1279 bytes} [Thu May 12 20:45:00 2022] DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 20:45:00.343932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:00.344551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:00.350839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:00.351313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:00.352089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:00.352535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:00.479492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:00.487243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:00.489117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:00.490376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-931f9ae5-8540-4805-8a63-dce5eafed5d4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.150376 May 12 20:45:00.490924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 443/914] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:00 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:01.510152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:01.510854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:01.517193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:01.517678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:01.518440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:01.518876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:01.651637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:01.659451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:01.661702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:01.662869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-998dd6de-d36c-4ca3-a77b-0397854bb246 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.157373 May 12 20:45:01.663434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 472/915] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:01 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:02.680310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:02.680928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:02.687360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:02.687809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:02.688575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:02.689013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:02.825074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:02.837038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:02.837466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:02.838666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-450bf371-6900-43e8-8172-3dca4c3b4079 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.162337 May 12 20:45:02.843149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 444/916] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:02 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:03.855655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:03.856327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:03.862842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:03.863295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:03.864846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:03.865448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:03.996157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:04.003944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:04.006172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:04.007580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-22035d59-a54f-48be-89ab-5a07cad38edc tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.155748 May 12 20:45:04.008140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 473/917] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:03 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:05.025964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:05.026571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:05.032849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:05.033316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:05.034072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:05.034503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:05.161381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:05.169888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:05.171386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:05.172577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0f0aa460-3b6f-432b-90a0-d17baf0ffb25 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.150433 May 12 20:45:05.173122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 445/918] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:05 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:06.191537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:06.192589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:06.198513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:06.203465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:06.203465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:06.203465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:06.336384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:06.344142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:06.345673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:06.346823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-73faa545-db70-4428-b11a-9f13f05dfd3b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.159231 May 12 20:45:06.347372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 474/919] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:06 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:07.365374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:07.365990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:07.372356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:07.372802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:07.373588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:07.374024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:07.760465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:07.768148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:07.770180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:07.771357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-462b68e8-4cdd-4467-a622-9b19c8a5eb06 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.410341 May 12 20:45:07.771907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 446/920] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:07 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:08.790358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:08.790963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:08.797242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:08.797726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:08.798486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:08.798923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:08.924112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:08.932435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:08.933975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:08.935138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5b834e67-ed17-4037-8d81-08b1a046a8d7 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.149615 May 12 20:45:08.935697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 475/921] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:08 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:09.953464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:09.954068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:09.960884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:09.961366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:09.962109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:09.962545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:10.088442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:10.096251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:10.098434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:10.099594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7b2da519-148b-42b5-83d5-bdf894fd9db9 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.150159 May 12 20:45:10.100145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 447/922] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:09 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:11.118408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:11.118947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:11.125220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:11.125730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:11.126496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:11.126937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:11.260277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:11.268085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:11.269616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:11.270764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3826e646-f98f-45ab-a755-6b093e5c4cd0 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.156348 May 12 20:45:11.271309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 476/923] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:11 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:12.288772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:12.289458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:12.295831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:12.296288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:12.297048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:12.297693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:12.426680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:12.434501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:12.436010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:12.437171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bef519f0-7852-456c-b711-aa14178f2a08 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153155 May 12 20:45:12.437758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 448/924] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:12 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:13.455215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:13.455865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:13.462331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:13.462796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:13.463573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:13.464009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:13.594114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:13.602370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:13.603883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:13.605058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ee0f6141-bef8-4aca-9118-722eaa6bb6de tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153735 May 12 20:45:13.605645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 477/925] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:13 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:14.624008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:14.624555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:14.630680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:14.631129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:14.632157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:14.632593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:14.762610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:14.770426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:14.771945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:14.773105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-07bbf734-95c0-4fde-a6de-774f179f234e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153066 May 12 20:45:14.773684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 449/926] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:14 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:15.791159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:15.791790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:15.798158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:15.798611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:15.799376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:15.799815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:15.927347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:15.935083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:15.936595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:15.937782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af87f1d8-4c65-485a-b4b6-6b35a042e949 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.150625 May 12 20:45:15.938339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 478/927] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:15 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:16.956262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:16.957765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:16.964323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:16.964773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:16.965555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:16.965990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:17.091609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:17.099571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:17.101079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:17.102264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2cdbf3db-53c4-4e8e-93f0-658f478d0ef4 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.150045 May 12 20:45:17.102822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 450/928] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:16 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:18.120364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:18.121000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:18.127295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:18.127746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:18.128513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:18.129555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:18.266409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:18.274651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:18.276215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:18.277520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c044da4c-8160-4412-bc8c-9810da31f071 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.160954 May 12 20:45:18.278093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 479/929] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:18 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:19.301595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:19.302141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:19.308468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:19.308923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:19.309722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:19.310162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:19.442721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:19.451095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:19.452625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:19.453827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8ce37690-bdde-4a01-9f87-b5a52cc36d42 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.157164 May 12 20:45:19.454523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 451/930] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:19 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:20.472493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:20.473194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:20.479036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:20.479480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:20.480235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:20.480667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:20.610347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:20.618828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:20.620340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:20.621528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d76bb2ad-33ec-4c06-8728-bbc37344a5e6 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153172 May 12 20:45:20.622087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 480/931] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:20 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:21.640697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:21.641329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:21.648252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:21.648713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:21.649499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:21.649940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:21.779177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:21.787107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:21.788790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:21.790522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9fb1fa34-dcc6-4808-af20-09ea2ae86ad5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153682 May 12 20:45:21.791068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 452/932] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:21 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 20:45:22.808883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:22.809536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:22.815756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:22.816220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:22.817002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:22.817468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:22.947341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:22.955034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:22.957103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:22.958806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-29e2f1ca-074b-4171-a630-ecf28695ab78 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.153773 May 12 20:45:22.959358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 481/933] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:22 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:23.977197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:23.977984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:23.984764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:23.985219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:23.986054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:23.986617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:24.158191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:24.166894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:24.168597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:24.169950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-afb9a658-2396-453d-9f19-900f348f4115 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.196879 May 12 20:45:24.176247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 453/934] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:23 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:25.038504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:25.039554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:25.045933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.046393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.047170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.047611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.078405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3e780ddd-3383-46c3-aebc-96a74840a3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044450 May 12 20:45:25.078968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 482/935] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:45:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:45:25.188373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:25.188998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:25.209212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.209704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.210495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.210934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.234719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:25.235217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:25.242410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.243075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.243851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.244354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.278906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fb5279df-1d62-4dc5-b674-cd11e02f7893 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2" status: 200 len: 194 microversion: 2.1 time: 0.049390 May 12 20:45:25.279896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 483/936] 10.222.0.59 () {58 vars in 1412 bytes} [Thu May 12 20:45:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:45:25.291002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:25.291526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:25.298113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.298575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.299353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.299800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.381922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:45:25.414411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:25.419026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:25.420531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:25.421721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-73c047be-058a-44c6-bdd0-0f927488259e tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1724 microversion: 2.20 time: 0.237651 May 12 20:45:25.422277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 454/937] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:25 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:25.602105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-52c73852-9318-4866-be95-a8efdf448c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2" status: 202 len: 0 microversion: 2.1 time: 0.315664 May 12 20:45:25.603112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 484/938] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:45:25 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/05d2c61c-0713-4a12-b11d-b8c8b092dde2 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 20:45:25.791491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-307be584-7de2-4323-b7f8-7fcde2c4e67f req-f33db636-51a4-4aaf-812d-72141c8430ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280983fe-4f61-41a6-b6db-4cfa7ac32703", "name": "network-vif-deleted", "tag": "24fac010-1311-4f7d-b3cd-b5930100d126"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:45:25.799395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-307be584-7de2-4323-b7f8-7fcde2c4e67f req-f33db636-51a4-4aaf-812d-72141c8430ae service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:25.800061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-307be584-7de2-4323-b7f8-7fcde2c4e67f req-f33db636-51a4-4aaf-812d-72141c8430ae service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:25.812445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-307be584-7de2-4323-b7f8-7fcde2c4e67f req-f33db636-51a4-4aaf-812d-72141c8430ae service nova] Creating event network-vif-deleted:24fac010-1311-4f7d-b3cd-b5930100d126 for instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 on hv-cinder-81565 May 12 20:45:25.820446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-307be584-7de2-4323-b7f8-7fcde2c4e67f req-f33db636-51a4-4aaf-812d-72141c8430ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 May 12 20:45:25.821062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 455/939] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:45:26.440561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:26.441369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:26.447849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:26.448301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:26.449056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:26.449521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:26.481975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:26.482461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:26.482912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lazy-loading 'fault' on Instance uuid 280983fe-4f61-41a6-b6db-4cfa7ac32703 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:45:26.527800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:26.539425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:26.539648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ce721d7163430dbf31ffbbf28c2094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3bcc803e53f46efb996577417eca77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:45:26.540850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-697c727a-31a9-417f-ad24-c37c2b119e74 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 200 len: 1371 microversion: 2.20 time: 0.104585 May 12 20:45:26.541599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 485/940] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:26 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 20:45:27.560368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:27.561001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:45:27.567691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:27.568145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:27.568909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:45:27.569370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:45:27.583156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:45:27.584953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:45:27.586760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:45:27.587671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:45:27.588960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:45:27.590123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:45:27.590123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-675f1bed-ce06-48ce-82ec-d76c3e3eb826 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.030808 May 12 20:45:27.590123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 456/941] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:45:27 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:45:27.595058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a4f4c33c-a7db-4d2c-a283-798083500ee5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '.version_select at 0x7f4e62d85160>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:45:27.656740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a4f4c33c-a7db-4d2c-a283-798083500ee5 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233400354" status: 204 len: 0 microversion: 2.20 time: 0.065394 May 12 20:45:27.657356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 486/942] 10.222.0.59 () {60 vars in 1258 bytes} [Thu May 12 20:45:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233400354 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 20:46:16.782053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:46:16.782658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:16.790073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:16.790545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:16.791308 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:16.791743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:16.814515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lazy-loading 'flavor' on Instance uuid a2d38838-7cd2-4f6f-a3a8-36148bd113ad {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:46:17.088304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c8d5b334-77e8-4e25-a758-5eac2e58afe9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "POST /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad/action" status: 202 len: 0 microversion: 2.1 time: 0.309912 May 12 20:46:17.088890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 457/943] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 20:46:16 2022] POST /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:46:17.098167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:17.098860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:17.105317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:17.105770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:17.106535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:17.106964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:17.241981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:17.249431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6b594499-d044-4a2a-8b93-3a8dcd88009e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156016 May 12 20:46:17.249975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 487/944] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:18.268903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:18.269731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:18.275729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:18.276322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:18.277011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:18.277496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:18.407859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:18.415436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8d4b02f5-19a0-4fe8-9129-843424bcf835 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151410 May 12 20:46:18.415996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 458/945] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:19.432509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:19.433121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:19.439484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:19.439956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:19.440747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:19.441186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:19.570610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:19.578050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e20404e9-3b82-4c81-8367-314b2f61ea0b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149371 May 12 20:46:19.578609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 488/946] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:20.596043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:20.597288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:20.605454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:20.605912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:20.606696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:20.607137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:20.755138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:20.763764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-95f95d1b-ade4-444c-9964-1ae52f9e647a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.172553 May 12 20:46:20.764342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 459/947] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:21.481170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:46:21.481385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:46:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:46:21.784310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:21.785008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:21.791323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:21.791772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:21.793295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:21.793758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:21.923089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:21.931155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-abe320b8-a4e0-4b5a-8b40-6e3c3d00001c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151061 May 12 20:46:21.931715 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 489/948] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:22.947354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:22.947972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:22.954361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:22.954819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:22.955579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:22.956648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:23.087449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:23.094906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f488a30a-d882-4475-b856-3eed3af42d6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151484 May 12 20:46:23.095463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 460/949] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:24.111688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:24.113566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:24.119821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:24.120268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:24.121029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:24.121490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:24.261843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:24.269143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c59cb3cf-38c7-4adf-b596-b28abc3d5eb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.161230 May 12 20:46:24.269734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 490/950] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:25.286064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:25.286676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:25.293111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:25.293616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:25.294448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:25.294885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:25.425616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:25.433087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b5ae7b09-54a4-47e7-aff9-a3df79b2f1a9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150933 May 12 20:46:25.433691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 461/951] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:26.449967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:26.450559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:26.457096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:26.457516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:26.458275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:26.458710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:26.594144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:26.601877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9136f306-25cc-451c-a526-99fc5bee830f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155713 May 12 20:46:26.602422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 491/952] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:27.618521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:27.619216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:27.625553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:27.626010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:27.626779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:27.627217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:27.826367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:27.834329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3e5d17f1-d9ec-4915-bb01-c009b234fcfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.219658 May 12 20:46:27.834899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 462/953] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:28.850367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:28.850984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:28.857342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:28.857808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:28.858626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:28.859052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:28.994274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:29.001749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a0d1004a-8c4d-413a-ae0f-c07bc6a42af4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155270 May 12 20:46:29.002317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 492/954] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:30.019634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:30.020245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:30.026637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:30.027068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:30.027838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:30.028278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:30.155429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:30.163009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e6bb7430-ad71-4086-bdb8-601314d6687c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147797 May 12 20:46:30.163565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 463/955] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:31.180053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:31.180625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:31.186886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:31.187340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:31.188108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:31.188546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:31.316089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:31.323345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c64c04a6-8415-4249-a926-19e2aafbfe6e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147294 May 12 20:46:31.323935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 493/956] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:32.340992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:32.341960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:32.348871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:32.349350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:32.350123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:32.350564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:32.482445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:32.490229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8a51de58-560e-413b-b0d9-1c8ac59667bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153142 May 12 20:46:32.490787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 464/957] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:33.507498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:33.508122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:33.514552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:33.515007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:33.515773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:33.516213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:33.645829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:33.653127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3949a336-bda3-4c33-b873-d4b75d8abfa3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149789 May 12 20:46:33.653719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 494/958] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:34.151691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-08b18dc6-144f-4970-a803-834d36def1f0 req-069bb251-38b3-4fde-8e87-8df45ad0bd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "name": "network-vif-unplugged", "status": "completed", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:46:34.161035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-08b18dc6-144f-4970-a803-834d36def1f0 req-069bb251-38b3-4fde-8e87-8df45ad0bd6d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:34.165868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-08b18dc6-144f-4970-a803-834d36def1f0 req-069bb251-38b3-4fde-8e87-8df45ad0bd6d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:34.172488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-08b18dc6-144f-4970-a803-834d36def1f0 req-069bb251-38b3-4fde-8e87-8df45ad0bd6d service nova] Creating event network-vif-unplugged:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:46:34.177787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-08b18dc6-144f-4970-a803-834d36def1f0 req-069bb251-38b3-4fde-8e87-8df45ad0bd6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029851 May 12 20:46:34.178376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 465/959] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:46:34.670178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:34.670800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:34.677102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:34.677583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:34.678354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:34.678792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:34.805480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:34.814297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9b2a4aea-1e50-4ec8-8ae6-b7e6e158b5b1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147614 May 12 20:46:34.815360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 495/960] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:34 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:35.833992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:35.834718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:35.840919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:35.841409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:35.842186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:35.842627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:35.919686 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:46:35.920225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:46:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:46:35.975354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:35.982611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-80737dfa-450b-492d-9bef-d19697a55142 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154246 May 12 20:46:35.983167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 466/961] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:36.999557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:37.000091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:37.007397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:37.007851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:37.008607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:37.009040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:37.134401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:37.141688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-52829f8e-b5e1-4679-ac0a-0efc6214b223 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.146011 May 12 20:46:37.142235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 496/962] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:38.158754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:38.159301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:38.166104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:38.166556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:38.167321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:38.167760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:38.298114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:38.305636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-808b8be8-a3a5-4a74-8631-8a177f9e58b2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150737 May 12 20:46:38.306201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 467/963] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:39.323242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:39.323864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:39.330056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:39.330506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:39.331271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:39.332230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:39.462359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:39.469586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b5f3d7d-762f-487f-bf31-e7e591dbc141 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150351 May 12 20:46:39.470140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 497/964] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:40.486749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:40.487381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:40.494881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:40.500996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:40.500996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:40.500996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:40.634412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:40.641706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60364eac-db0a-40a4-ba2a-bdfa002a0b35 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158904 May 12 20:46:40.642267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 468/965] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:41.659234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:41.659926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:41.666258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:41.666703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:41.667485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:41.667918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:41.796083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:41.804265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cddad21e-244e-4fa2-8d6a-7f99210babb3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148846 May 12 20:46:41.804826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 498/966] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:42.821860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:42.822466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:42.828732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:42.829239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:42.829966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:42.830432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:42.964612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:42.972003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-68b4fbdc-b420-4b98-88bc-0b12a87f05ff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154011 May 12 20:46:42.972751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 469/967] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:43.989533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:43.990905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:43.997172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:44.000398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:44.000398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:44.000398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:44.130167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:44.137636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-61831e12-884c-4137-b903-49bc6a6c7285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152508 May 12 20:46:44.138180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 499/968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:45.154123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:45.154693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:45.161007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:45.161490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:45.162255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:45.162696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:45.290113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:45.297394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d8a5c749-773a-4c38-ac0b-18c98b49aa2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147151 May 12 20:46:45.297945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 470/969] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:46.314953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:46.316123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:46.322777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:46.323220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:46.323972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:46.324404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:46.454431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:46.462560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0d046d4c-014b-4f5a-b6da-9e5c4fed30b5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151458 May 12 20:46:46.463116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 500/970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:47.479421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:47.480147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:47.486401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:47.486847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:47.488078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:47.488571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:47.616358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:47.623898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-831cf32d-532a-4bf6-9bd8-60e279a0603b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148313 May 12 20:46:47.624472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 471/971] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:48.640592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:48.641211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:48.648121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:48.648565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:48.649355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:48.649799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:48.776573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:48.783791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f7382088-fc61-409b-8c96-0a353658e125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147128 May 12 20:46:48.784349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 501/972] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:49.802324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:49.802891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:49.809416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:49.809874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:49.810642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:49.811087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:49.947700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:49.954996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f102a961-ef1d-42d0-ac46-bbaad2bda95a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157495 May 12 20:46:49.955559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 472/973] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:50.972119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:50.972737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:50.979819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:50.980326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:50.981093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:50.981560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:51.110918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:51.118572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f0ae0497-afaa-45d7-bfad-5eee6a57f949 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150424 May 12 20:46:51.119074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 502/974] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:52.136501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:52.137045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:52.143282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:52.143727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:52.144484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:52.145000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:52.270730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:52.278191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e611aa32-55ec-409c-84b6-941d48360e62 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.145869 May 12 20:46:52.278757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 473/975] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:53.295868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:53.296406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:53.303923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:53.304367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:53.305133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:53.305613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:53.432816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:53.440122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3164fe79-b77d-4098-870e-5c81236011f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148246 May 12 20:46:53.440685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 503/976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:54.458346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:54.458952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:54.465255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:54.465737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:54.466510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:54.466947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:54.597595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:54.604954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-47558269-92e7-44b9-9b81-14f2ad580e24 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151176 May 12 20:46:54.605548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 474/977] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:55.621998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:55.622604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:55.628951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:55.630172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:55.630941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:55.631381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:55.764152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:55.771540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-571e2a69-2dae-4e63-9999-09dd04e1981f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153430 May 12 20:46:55.772250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 504/978] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:56.789100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:56.789742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:56.796078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:56.796557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:56.797342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:56.797781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:56.926043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:56.933979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c14e61f9-35c9-4496-86f6-651ad59c1bf2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148783 May 12 20:46:56.934543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 475/979] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:57.951703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:57.952315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:57.958915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:57.959369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:57.960134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:57.960576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:58.090805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:58.098311 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b6d1e55d-d09b-42e4-9e10-cd69a5e39510 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150446 May 12 20:46:58.098873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 505/980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:46:59.115821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:46:59.116377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:46:59.122797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:59.123250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:59.124023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:46:59.124461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:46:59.253616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:46:59.261234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dcfdaeba-68c7-4134-8a43-3de38c910e7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150132 May 12 20:46:59.261908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 476/981] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:46:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:00.279091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:00.279667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:00.285987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:00.286445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:00.287202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:00.287636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:00.422067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:00.430026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-95330b11-4c1f-432c-998e-c0eb3b0de765 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154871 May 12 20:47:00.430590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 506/982] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:47:01.447552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:01.448166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:01.454736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:01.455183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:01.456034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:01.456566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:01.588529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:01.595938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c03e5854-f1ef-4d8f-95f6-5b7072fc634e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152538 May 12 20:47:01.596510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 477/983] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:02.611978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:02.612596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:02.619019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:02.619474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:02.620242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:02.620683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:02.749964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:02.758144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-245b43d0-500f-4b71-b213-b1d355040c05 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150111 May 12 20:47:02.758702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 507/984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:03.775668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:03.776196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:03.782503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:03.782954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:03.783718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:03.784158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:03.914841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:03.922447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1d0f4004-b9b1-4fda-ae64-3845e2893217 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150702 May 12 20:47:03.923252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 478/985] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:04.939821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:04.940430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:04.947080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:04.947527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:04.948283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:04.948716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:05.075047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:05.082404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ef8c1616-089e-4ddc-b0c0-bb6a89fa4504 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.146460 May 12 20:47:05.082988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 508/986] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:06.100171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:06.100757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:06.107447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:06.107897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:06.108669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:06.109108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:06.258557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:06.266007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-153837a4-dbaf-460a-8582-e74b92924036 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.170542 May 12 20:47:06.266570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 479/987] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:07.283269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:07.283830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:07.290505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:07.290954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:07.291708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:07.292144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:07.422280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:07.430669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8e0354d6-eb08-4456-86e0-671e0ddc2bf7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151392 May 12 20:47:07.431232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 509/988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:07 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:08.448264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:08.448908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:08.455178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:08.455625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:08.456382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:08.456820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:08.584795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:08.592218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ebc092fb-83d6-4228-9503-2259a6217df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147859 May 12 20:47:08.592775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 480/989] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:09.609953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:09.610574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:09.617073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:09.617558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:09.618333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:09.618769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:09.825934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:09.825934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-03a397fc-bfe9-416f-8699-89dc784aadbd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152815 May 12 20:47:09.825934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 510/990] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:10.841259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:10.841868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:10.848414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:10.849825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:10.850607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:10.851042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:11.236964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:11.245085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-27b9191f-2335-418d-823b-683db026db54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.407874 May 12 20:47:11.245676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 481/991] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:12.262522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:12.263063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:12.269302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:12.269767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:12.270539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:12.271260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:12.401410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:12.408720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f473cb1f-065e-4d84-a9d8-65139e7bc22b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150116 May 12 20:47:12.409416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 511/992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:13.426406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:13.427269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:13.433483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:13.433936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:13.434709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:13.435145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:13.562251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:13.570180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bfb63a83-3cd6-4fae-88bc-210926daf5a6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147658 May 12 20:47:13.570744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 482/993] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:14.588212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:14.588907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:14.596562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:14.597013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:14.597862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:14.598319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:14.729258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:14.736578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0d2d0afc-8893-4fac-a312-c7e6e0eb69a2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152454 May 12 20:47:14.737139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 512/994] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:15.754764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:15.756835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:15.763049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:15.765573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:15.765573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:15.765573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:15.897958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:15.904776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-59141d10-6436-4f4e-b785-ffc3e30593a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154071 May 12 20:47:15.905352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 483/995] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:16.922022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:16.922738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:16.930065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:16.930511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:16.931267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:16.931702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:17.064504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:17.072494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bfdf6675-d5e3-4a8b-b172-a2ca6766a181 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154366 May 12 20:47:17.073050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 513/996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:18.089927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:18.090552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:18.096966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:18.097485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:18.098260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:18.098789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:18.226861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:18.234278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a65f013f-e564-4071-9fca-82a3bbcaa675 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148242 May 12 20:47:18.234842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 484/997] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:19.251065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:19.251600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:19.258716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:19.259167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:19.259923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:19.260360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:19.400308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:19.407888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-23b15974-7b8f-4b96-a75e-ceaab3d58627 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160745 May 12 20:47:19.408451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 514/998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:20.425827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:20.426444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:20.432822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:20.433265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:20.434052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:20.434484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:20.561797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:20.569302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3f3f1ca8-535d-4e92-8fa0-651759288e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147365 May 12 20:47:20.569871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 485/999] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:21.586349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:21.586965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:21.593058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:21.593537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:21.594301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:21.594740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:21.721769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:21.729685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c0b41dc0-e57b-4d24-8f84-da243ed29929 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147280 May 12 20:47:21.730250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 515/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:22.746290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:22.746940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:22.753407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:22.753860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:22.754995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:22.755763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:22.898751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:22.906175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-94a443d0-65b1-4b4c-b180-cb8518c4573c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.163766 May 12 20:47:22.906733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 486/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:23.923277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:23.923921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:23.931431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:23.931882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:23.932679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:23.933119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:24.065986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:24.073907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c8a03d27-8987-47a6-ab8e-fc179f7bd3f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154547 May 12 20:47:24.074463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 516/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:25.091181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:25.091804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:25.099893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:25.100389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:25.101210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:25.101696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:25.244859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:25.253675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-50caf2dc-9661-4e04-bfd3-faeee45ae344 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166641 May 12 20:47:25.254370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 487/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:26.271007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:26.271561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:26.278236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:26.278685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:26.279447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:26.279878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:26.405791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:26.413565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-abba856d-d8ec-4fdd-b27b-4b0c0f21804c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.146502 May 12 20:47:26.414127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 517/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:27.430342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:27.430962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:27.438384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:27.438833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:27.439600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:27.440036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:27.573687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:27.580986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cdc259cf-fbdb-4631-ac13-7eb8f51d9dd1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154920 May 12 20:47:27.581590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 488/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:28.598173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:28.598813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:28.605237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:28.605710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:28.606465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:28.606898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:28.739545 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:28.747045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f38983e5-061b-4d18-9f05-34438b9b8fb5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152791 May 12 20:47:28.747604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 518/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:29.764320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:29.764937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:29.771342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:29.772504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:29.773386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:29.773828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:29.901754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:29.909079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f9dbe982-3a15-44f6-95a5-a7403d5f5535 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148664 May 12 20:47:29.909669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 489/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:29 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:30.926508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:30.927129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:30.934049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:30.934507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:30.935308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:30.935750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:31.064807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:31.072371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-69b07618-eb87-4605-8ce1-4b710e59b844 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149776 May 12 20:47:31.072943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 519/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:32.142859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:32.143389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:32.149840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:32.150280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:32.151047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:32.151487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:32.278744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:32.286004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ddcf444-4183-49e2-bb66-22e0630bb1b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147165 May 12 20:47:32.286564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 490/1009] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:33.304443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:33.305015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:33.311527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:33.311986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:33.312792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:33.313232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:33.441170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:33.449191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c226e340-89c5-4ac8-8940-250afb340206 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149526 May 12 20:47:33.449793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 520/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:34.466118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:34.466732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:34.473040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:34.473518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:34.474282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:34.474748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:34.605295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:34.612590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-309e190e-aeac-41c6-aaeb-e4bbf3bd3a68 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150367 May 12 20:47:34.613169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 491/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:34 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:35.630219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:35.631379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:35.638021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:35.638475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:35.639239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:35.639677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:35.772730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:35.780277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fa08b99b-247b-4ec3-8956-5763238815de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153896 May 12 20:47:35.780837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 521/1012] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:36.797534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:36.798130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:36.805907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:36.806668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:36.807542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:36.808061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:36.956464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:36.965419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7bfd1042-9d28-4819-89c1-b9f3396d8172 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.171730 May 12 20:47:36.965994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 492/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:37.983205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:37.983818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:37.990749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:37.991204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:37.991962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:37.992402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:38.119282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:38.126567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-244b56af-7b11-4984-95da-37498b3f2051 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147288 May 12 20:47:38.127132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 522/1014] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:39.144322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:39.144888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:39.152053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:39.152507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:39.153300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:39.153755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:39.305438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:39.313627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6807a51f-2929-40b7-ad83-dd4345f7dd17 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.173169 May 12 20:47:39.314348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 493/1015] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:40.332271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:40.332824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:40.340258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:40.340712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:40.341550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:40.341985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:40.498638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:40.506793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c3996fcf-d562-4759-866d-a57ff5d32df5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.178604 May 12 20:47:40.507423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 523/1016] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:41.524934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:41.525552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:41.531856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:41.532303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:41.533062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:41.533524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:41.661991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:41.669219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5f32f003-3142-4c2f-bcf9-3528cd343db5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148777 May 12 20:47:41.669818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 494/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:42.685961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:42.686561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:42.692861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:42.693913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:42.694717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:42.695146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:42.822580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:42.829882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8fd9d7bc-296d-4471-befc-654aadad6c21 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147803 May 12 20:47:42.830443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 524/1018] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:43.847280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:43.847903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:43.854161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:43.854613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:43.855382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:43.855824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:43.992657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:44.000268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3aed1d00-387e-428f-87a7-a8826b503482 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156883 May 12 20:47:44.000829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 495/1019] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:45.018380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:45.019000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:45.026354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:45.026803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:45.027591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:45.028039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:45.165122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:45.172548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e334bb4c-a81f-4e5e-911d-dfe6717928c4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158100 May 12 20:47:45.173170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 525/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:46.190051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:46.190949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:46.197918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:46.198371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:46.199150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:46.199592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:46.339302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:46.346879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-315490a0-ff28-4cfd-98ac-74c368536c30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160844 May 12 20:47:46.347443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 496/1021] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:47.363515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:47.364129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:47.370993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:47.371557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:47.372333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:47.372773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:47.505232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:47.513547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eec27ce1-d3ed-446e-b202-7415deb8f942 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153932 May 12 20:47:47.514114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 526/1022] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:48.532260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:48.532260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:48.538395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:48.538650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:48.539387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:48.539821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:48.681791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:48.689234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a05ff6b5-567e-4097-870b-74daeb572d4c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.162742 May 12 20:47:48.689840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 497/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:49.705898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:49.706501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:49.713298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:49.713755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:49.714507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:49.714937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:49.843867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:49.851985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-94020330-fe27-4bd6-9840-d5238700f379 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150024 May 12 20:47:49.852551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 527/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:50.868341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:50.868952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:50.875267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:50.875709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:50.876600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:50.877300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:51.013988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:51.021466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f2daaf5e-382d-44ea-ac0d-b51207f45340 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156955 May 12 20:47:51.022210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 498/1025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:52.039195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:52.039800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:52.045798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:52.046243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:52.047001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:52.047430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:52.176958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:52.184994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0ae7fe13-edd8-4a99-916e-69dc4d5c6496 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150324 May 12 20:47:52.185599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 528/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:53.202525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:53.203317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:53.211417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:53.211867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:53.212650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:53.213084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:53.345503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:53.353543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f9c6bc01-1af3-4daf-b9a7-4743ec1230b8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155146 May 12 20:47:53.354113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 499/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:54.371322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:54.371966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:54.378366 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:54.378821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:54.379585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:54.380026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:54.505637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:54.513224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-634b3cbd-ba86-4a6a-bcfe-8c6b79d3b6e0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.145847 May 12 20:47:54.513811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 529/1028] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:55.530468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:55.531220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:55.537692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:55.539384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:55.539664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:55.540103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:55.678220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:55.686035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bb11e5a9-a8fa-4c53-a4c7-db0ad4ac2a7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.159366 May 12 20:47:55.686597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 500/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:56.702762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:56.703383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:56.710433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:56.710933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:56.711761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:56.712211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:56.960403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:56.968971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0988273c-2c09-4875-af05-88ad37f1fd54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.270025 May 12 20:47:56.969580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 530/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:57.987445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:57.988065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:57.995313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:57.995770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:57.996557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:57.996998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:58.133173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:58.140567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a5d1967d-4f68-4cf6-b77a-7f5a31cade7a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157094 May 12 20:47:58.141123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 501/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:47:59.158709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:47:59.158709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:47:59.165808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:59.166266 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:59.167049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:47:59.167490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:47:59.300281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:47:59.308627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6f5ba5a1-481c-4489-9130-ea676b2213e2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154697 May 12 20:47:59.309891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 531/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:47:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:00.328359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:00.328895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:00.335349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:00.335795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:00.336564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:00.336992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:00.526266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:00.533843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e10c5d99-0972-4f58-afaa-8f8313d832f9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.209437 May 12 20:48:00.534419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 502/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:01.551079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:01.551724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:01.568819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:01.570501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:01.571914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:01.572531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:01.717762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:01.725613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f1da4fde-50c4-4242-bfff-8d1fa6c347fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.178410 May 12 20:48:01.726230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 532/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:02.743646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:02.744654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:02.752253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:02.752774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:02.753686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:02.754126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:02.907382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:02.915583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d036a108-c98d-4062-aebb-a5061dcdf62e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.176093 May 12 20:48:02.916177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 503/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:03.940505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:03.941272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:03.949782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:03.953801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:03.953801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:03.953801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:04.126139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:04.137092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9b7fcdbe-bf70-4545-ac56-abfb1f1a0fde tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.202506 May 12 20:48:04.138106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 533/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:05.161196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:05.162030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:05.169407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:05.169863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:05.170645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:05.171082 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:05.317143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:05.325981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d12690b4-9191-493d-9f22-272aa0828a96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.168737 May 12 20:48:05.326643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 504/1037] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:06.344037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:06.344980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:06.352170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:06.352624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:06.353453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:06.353916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:06.518693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:06.528398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-75ae01dc-f1ce-4175-a060-6fc5240294c2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.188481 May 12 20:48:06.529645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 534/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:07.360440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:48:07.361159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:48:07.551569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:07.551988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:07.563734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:07.564410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:07.565707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:07.566418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:07.833781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:07.848616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-20c46ca7-d335-42ad-b75d-404286cd824d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.304855 May 12 20:48:07.849710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 505/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:07 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:08.876197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:08.876835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:08.884725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:08.885170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:08.885982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:08.886418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:09.049246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:09.059204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d778068e-c920-428e-8976-f808f049b1fb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.186712 May 12 20:48:09.060038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 535/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:10.078964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:10.079592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:10.088472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:10.090605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:10.090605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:10.090605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:10.274847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:10.282601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-28ce568b-a6ef-4ac6-887e-7e5c95bc61fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.207541 May 12 20:48:10.283180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 506/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:11.300379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:11.301080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:11.307552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:11.308011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:11.308797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:11.309237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:11.497219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:11.506279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a57098a-fc7c-4795-befe-39d224793631 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.209835 May 12 20:48:11.507052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 536/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:12.344661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:48:12.345421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:48:12.525732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:12.526366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:12.534651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:12.535370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:12.536855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:12.538135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:12.719215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:12.729073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8f727ce5-72e7-40ad-afb4-7048bf5d9c1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.207563 May 12 20:48:12.729689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 507/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:13.752395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:13.753054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:13.760323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:13.760769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:13.761619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:13.762060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:13.921927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:13.931418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cf3ea457-3e01-428e-9fa2-b67e6c42ec18 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.182874 May 12 20:48:13.939131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 537/1044] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:14.949143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:14.949872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:14.956398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:14.956860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:14.957692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:14.958134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:15.121929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:15.129888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd115f84-4d60-4cf9-bcc9-2879746d2387 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.184813 May 12 20:48:15.130480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 508/1045] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:16.150090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:16.150919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:16.157418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:16.157872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:16.158666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:16.159105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:16.316594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:16.325020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-07d4955a-b421-4c1b-81a5-0481312a86ad tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.180684 May 12 20:48:16.325640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 538/1046] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:17.345228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:17.345902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:17.353844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:17.354373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:17.355269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:17.355752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:17.512376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:17.520394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-db5e7180-964e-4b7f-993a-d976727c0084 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.180857 May 12 20:48:17.520994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 509/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:18.538484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:18.539130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:18.545635 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:18.546079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:18.546854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:18.547280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:18.685782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:18.695128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5dcbe38d-bded-4aed-bc73-cc9c71506b1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.161138 May 12 20:48:18.695712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 539/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:19.712788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:19.713443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:19.720326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:19.720774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:19.721581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:19.722020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:19.861644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:19.871388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-52dbf688-f7df-4545-abb1-ea38e21d9af8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.162614 May 12 20:48:19.871654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 510/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:20.888422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:20.889067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:20.895296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:20.895749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:20.897102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:20.897585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:21.035194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:21.043235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-681fd057-be45-4a84-a172-1f434c975318 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158888 May 12 20:48:21.043796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 540/1050] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:22.060008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:22.060622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:22.066988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:22.067436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:22.068227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:22.068876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:22.201081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:22.208330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-93429927-86c9-482e-ad24-c1d7a1b4cab5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152204 May 12 20:48:22.209895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 511/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:23.227005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:23.227642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:23.234823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:23.235271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:23.236039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:23.236477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:23.385438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:23.392685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2c6f6e2f-64e5-4275-8938-53ce2f050f03 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.170980 May 12 20:48:23.393250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 541/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:24.511412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:24.512065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:24.518020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:24.518470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:24.519239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:24.519679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:24.648829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:24.656173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ecf7f0d-87a3-4ce2-89be-ad31d9545985 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.250159 May 12 20:48:24.656741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 512/1053] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:25.675106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:25.675722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:25.683168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:25.683942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:25.684994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:25.685567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:25.823021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:25.830488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-066d9c6d-fdf0-4ff2-be66-51d257d1ea92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160600 May 12 20:48:25.831042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 542/1054] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:26.848530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:26.849344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:26.856655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:26.857111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:26.857938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:26.858380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:26.990378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:26.998234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a50309cf-3a3f-4005-a13d-85b7b8f2a824 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153636 May 12 20:48:26.998793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 513/1055] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:28.016407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:28.017011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:28.024051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:28.024493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:28.025257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:28.025711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:28.157080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:28.165900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-85d29bc7-a7ec-4b77-babc-bd37eb127741 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153395 May 12 20:48:28.166471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 543/1056] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:29.183017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:29.183561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:29.191771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:29.192221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:29.192988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:29.193450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:29.325784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:29.333841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9e2532b9-32af-4031-8a3c-50443b2ae0c8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154889 May 12 20:48:29.334941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 514/1057] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:29 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:30.352026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:30.352664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:30.359053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:30.359528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:30.360295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:30.360731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:30.488980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:30.496353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-58a0c8a1-7741-41b2-b2f9-9ed74742e582 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148307 May 12 20:48:30.496918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 544/1058] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:30.690223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:48:30.690419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:48:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:48:31.513416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:31.514012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:31.520262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:31.520708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:31.521496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:31.522556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:31.652263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:31.659621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f2a14a8-4240-472b-8a29-5745fedf0447 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150109 May 12 20:48:31.660181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 515/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:32.677695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:32.678378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:32.684713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:32.685166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:32.685964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:32.686399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:32.815172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:32.823410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d587a941-7329-4061-b19b-b831e3870a27 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149607 May 12 20:48:32.823971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 545/1060] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:33.841183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:33.841829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:33.848132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:33.848578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:33.849369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:33.850380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:33.985709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:33.993368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8d040efb-508d-44f5-a23c-dacef74f9268 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156281 May 12 20:48:33.993932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 516/1061] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:35.011347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:35.012036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:35.018373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:35.018827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:35.019588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:35.020027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:35.149997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:35.157649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d50586cf-6cbc-41ea-b539-e82c1004c150 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150409 May 12 20:48:35.158216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 546/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:36.174125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:36.174679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:36.181049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:36.181535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:36.182298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:36.182733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:36.310624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:36.318106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-12e23fe5-6d8f-4412-b620-f0fad42fc371 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148030 May 12 20:48:36.319682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 517/1063] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:37.336847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:37.337487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:37.343897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:37.344346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:37.345110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:37.345577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:37.476074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:37.483581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-adb1f2ac-4087-4ce5-bf81-c54063365e2c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151661 May 12 20:48:37.484155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 547/1064] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:38.501426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:38.502073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:38.509422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:38.509873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:38.510638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:38.511075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:38.642933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:38.650982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c7f8bf2-059c-4ad9-b2d4-f6a59700063e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153531 May 12 20:48:38.651557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 518/1065] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:39.668866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:39.669525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:39.675994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:39.676450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:39.677224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:39.677694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:39.805722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:39.813198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-72128ae9-7018-4589-9fa2-428ea3fc9095 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148306 May 12 20:48:39.813788 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 548/1066] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:40.832309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:40.832862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:40.839388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:40.839833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:40.840606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:40.841037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:40.980142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:40.989120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ef80173c-0a45-42b1-950d-bc2785015d0d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160936 May 12 20:48:40.989731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 519/1067] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:42.007640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:42.008525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:42.015021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:42.015507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:42.016284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:42.016723 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:42.150660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:42.158412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6a3784fa-50dd-4af4-a418-7db121727e6d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154675 May 12 20:48:42.158754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 549/1068] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:43.176146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:43.176709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:43.183572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:43.184027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:43.184804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:43.185290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:43.321650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:43.328932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fe9431a7-3d4b-499b-a95e-a851203dd5f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156856 May 12 20:48:43.329527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 520/1069] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:44.346117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:44.346771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:44.353969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:44.354413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:44.355186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:44.355624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:44.495619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:44.503261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a6bb802-7d39-40bb-a78c-47b11a588cfa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.161019 May 12 20:48:44.503821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 550/1070] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:45.522465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:45.530675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:45.530675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:45.530675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:45.530974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:45.531177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:45.668144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:45.682199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8f196942-bffc-470d-bfcc-11b5293b1a1c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157794 May 12 20:48:45.682199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 521/1071] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:46.693052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:46.693945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:46.700470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:46.700922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:46.701757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:46.702200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:46.829696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:46.837807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b990d99-4307-4b2f-9d4b-944d28f0ac75 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148712 May 12 20:48:46.838370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 551/1072] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:47.854937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:47.855570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:47.862123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:47.862572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:47.863724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:47.863826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:47.996145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:48.003979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f549139a-19ce-4630-a2fc-b7655002b9df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152941 May 12 20:48:48.004546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 522/1073] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:49.022250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:49.022920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:49.029471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:49.029915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:49.030770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:49.031116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:49.169751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:49.177318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5f1f2441-e34c-4714-b404-0dfb1cc1f494 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158837 May 12 20:48:49.178726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 552/1074] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:50.195829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:50.196392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:50.202733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:50.203186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:50.203947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:50.204380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:50.348549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:50.359711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b4af8639-eba2-4eb5-ac99-c6cfe2c313ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.167952 May 12 20:48:50.360315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 523/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:51.377221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:51.377848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:51.384999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:51.385494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:51.386272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:51.386710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:51.520351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:51.528585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e9eb9953-d9bc-4f02-a4e9-a88e7d249caf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155233 May 12 20:48:51.529153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 553/1076] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:48:52.545901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:52.546512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:52.553732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:52.554184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:52.554958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:52.555395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:52.689025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:52.697472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3b7b6c7a-80e6-4bbf-9334-673f6de648c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155430 May 12 20:48:52.698036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 524/1077] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:53.714889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:53.715512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:53.721971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:53.722413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:53.723173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:53.723603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:53.856925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:53.864620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-864cfcba-807f-4619-ad48-91d86d04dfe8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153591 May 12 20:48:53.866078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 554/1078] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:54.883648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:54.884263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:54.890801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:54.891251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:54.892036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:54.892475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:55.026671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:55.034199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-66efd13a-2c44-47c1-a3ba-66b783a2fb57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155300 May 12 20:48:55.034772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 525/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:56.053644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:56.054473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:56.061152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:56.061741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:56.062511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:56.062950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:56.472638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:56.480191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e4839464-2bc6-44cf-b511-42e6d342a1ae tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.431434 May 12 20:48:56.480756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 555/1080] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:57.499014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:57.506147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:57.508483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:57.508934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:57.509761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:57.510194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:57.653263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:57.661022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b70a280f-2064-4c9d-b534-e9f193bb2fee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166190 May 12 20:48:57.661718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 526/1081] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:58.678585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:58.679193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:58.685608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:58.686076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:58.686824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:58.687255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:58.820539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:58.828029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-61422101-30d4-4f54-9a6f-ef82bc4eb0df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154420 May 12 20:48:58.828588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 556/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:48:59.846353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:48:59.847090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:48:59.854033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:59.854486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:59.855249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:48:59.855690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:48:59.991023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:48:59.998331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49ba4b3a-62c3-4975-9252-31d074d95302 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155935 May 12 20:48:59.999000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 527/1083] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:48:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:01.016010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:01.016656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:01.023483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:01.023936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:01.024717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:01.025157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:01.160644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:01.168827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-621bb138-a12f-4fcf-92f3-e8552528b609 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156672 May 12 20:49:01.169430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 557/1084] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:02.186336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:02.186942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:02.193687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:02.194135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:02.194920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:02.195360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:02.332617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:02.340992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-50fa2230-1ab9-4666-9065-4ec079767921 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158665 May 12 20:49:02.341595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 528/1085] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:03.359923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:03.360550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:03.367773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:03.368214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:03.368996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:03.369466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:03.506518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:03.514364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5e62509a-c192-4177-aac2-e22e162576d8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158325 May 12 20:49:03.514942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 558/1086] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:04.531547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:04.532145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:04.539244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:04.539725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:04.540497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:04.540937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:04.674703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:04.682604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15023458-22ad-4d0b-ac92-4395c9b5b1ba tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154943 May 12 20:49:04.683154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 529/1087] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:05.698963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:05.699579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:05.706459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:05.706907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:05.707674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:05.708122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:05.844132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:05.852787 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-187763ae-e3b5-4872-bd9c-45839a53bfb1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157688 May 12 20:49:05.853513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 559/1088] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:06.870666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:06.871291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:06.878769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:06.879219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:06.880034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:06.880473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:07.022021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:07.030468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0af8ffe8-01b3-40e5-9edf-35647a29744e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.164335 May 12 20:49:07.031050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 530/1089] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:08.048533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:08.049146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:08.055556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:08.056006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:08.056774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:08.057211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:08.196527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:08.204927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bb5e1812-4d5a-48cb-afd6-aba03f451d7e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160277 May 12 20:49:08.205532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 560/1090] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:09.222175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:09.222795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:09.229980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:09.230423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:09.231206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:09.231640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:09.457180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:09.465867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d4d61757-8d2d-48f2-83d1-1cf3ecc8d8a8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.247554 May 12 20:49:09.466463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 531/1091] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:10.482985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:10.483631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:10.490720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:10.491774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:10.492721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:10.493155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:10.636584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:10.649638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-965137fc-0ce7-419f-ae32-1b70a77c2d1f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.170112 May 12 20:49:10.650643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 561/1092] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:49:11.667472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:11.668084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:11.674416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:11.674869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:11.675634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:11.676106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:11.809562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:11.816916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d8e2326d-7fec-4016-9e1c-ae583048d1ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153406 May 12 20:49:11.817523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 532/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:12.833964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:12.834583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:12.841711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:12.842171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:12.842950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:12.843393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:12.976547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:12.984527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-768ab797-e797-4a95-ad0d-2cf8927fc21e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154437 May 12 20:49:12.985092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 562/1094] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:14.002491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:14.003100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:14.010157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:14.010611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:14.011389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:14.011826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:14.146040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:14.153636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-060b2f6c-ae05-4472-8a75-c41db6f415ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155122 May 12 20:49:14.154290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 533/1095] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:49:15.170295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:15.170847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:15.177381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:15.177827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:15.178744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:15.179292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:15.313062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:15.321102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-53ef2114-9fcb-4977-b312-9eec468e1eb4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154810 May 12 20:49:15.321699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 563/1096] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:16.339512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:16.340151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:16.346688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:16.347138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:16.347920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:16.348363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:16.483919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:16.491522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8de3c24e-61b5-4431-af63-efc54f803f2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156813 May 12 20:49:16.492092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 534/1097] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:49:17.508642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:17.509317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:17.515804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:17.516247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:17.517014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:17.517506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:17.652097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:17.659296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f8cba3e8-645b-42c3-a288-2ea4f1c05b0c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155426 May 12 20:49:17.659852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 564/1098] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:18.676475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:18.677113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:18.683507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:18.683954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:18.684716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:18.685156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:18.817487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:18.824955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0bdea9e8-ea95-4031-9888-5b2033425075 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152390 May 12 20:49:18.825549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 535/1099] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:19.842044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:19.842592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:19.849109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:19.849597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:19.850450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:19.850896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:19.983917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:19.991556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-48465d3a-7f45-480f-b8ec-228d48bf3c74 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153398 May 12 20:49:19.992131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 565/1100] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:21.009380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:21.009978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:21.016558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:21.017020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:21.017826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:21.018267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:21.156536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:21.164664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b7b5b431-dd52-46e8-b3b8-fe3bcbb315f3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.159414 May 12 20:49:21.165235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 536/1101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:22.181928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:22.182476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:22.188486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:22.188930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:22.189714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:22.190147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:22.321253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:22.328726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-304af845-3f84-476b-8a9b-814448b1b0a4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150922 May 12 20:49:22.329393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 566/1102] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:23.346443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:23.347064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:23.354172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:23.354621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:23.355384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:23.355818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:23.508886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:23.517787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-83874d7f-49cd-4271-a427-8fdf01e68d8d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.175076 May 12 20:49:23.518349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 537/1103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:49:24.536146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:24.536739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:24.543257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:24.543706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:24.544552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:24.544990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:24.677398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:24.685445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-be2c7d99-74c5-4518-8519-7b795ccca32a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153124 May 12 20:49:24.686006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 567/1104] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:25.703128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:25.703772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:25.710970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:25.711420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:25.712197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:25.712633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:25.844964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:25.852536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6ebe5c09-0713-45b0-8355-240da6acb62b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153352 May 12 20:49:25.853090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 538/1105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:49:26.870340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:26.870971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:26.877363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:26.877744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:26.878500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:26.878931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:27.007917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:27.015628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-afdb5ad7-e9ab-4fbf-81dd-47be641a7317 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149846 May 12 20:49:27.016201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 568/1106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:28.031965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:28.032616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:28.039550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:28.040001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:28.040769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:28.041210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:28.175932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:28.183789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cdb69a5f-943a-4768-8165-75904feb0e53 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155770 May 12 20:49:28.184352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 539/1107] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:29.201208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:29.201765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:29.208357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:29.208862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:29.209903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:29.210345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:29.342795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:29.350304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6bedc14a-73c3-4d86-98a0-312c5ab46fb2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153165 May 12 20:49:29.350918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 569/1108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:29 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:30.367426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:30.368019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:30.374477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:30.374936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:30.375704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:30.376143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:30.503476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:30.511872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b4b77a6f-f59f-4f86-84ee-2ab28724e24d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148327 May 12 20:49:30.512442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 540/1109] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:31.529447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:31.650862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:31.650862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:31.650862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:31.650862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:31.652738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:31.671316 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:31.678845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-82066fe8-625b-4205-8104-05134709606d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153227 May 12 20:49:31.679405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 570/1110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:32.695956 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:32.696576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:32.702932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:32.703388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:32.704164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:32.704605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:32.832439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:32.840485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c813733f-3f14-4220-a344-d193af6251ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148488 May 12 20:49:32.841062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 541/1111] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:33.857049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:33.857649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:33.863985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:33.864432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:33.865190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:33.865660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:34.004235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:34.011848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14749e64-d459-4051-98d0-560959a69622 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158772 May 12 20:49:34.012427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 571/1112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:35.028847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:35.029493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:35.035815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:35.036262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:35.037017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:35.037485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:35.169055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:35.176531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-90ef0541-208a-442e-a753-12ad3c5b93c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151572 May 12 20:49:35.177090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 542/1113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:36.193739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:36.194792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:36.201387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:36.201838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:36.202609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:36.203045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:36.333442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:36.341747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28bc8bc6-3c67-43f0-b2a2-77011feb2128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152049 May 12 20:49:36.342310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 572/1114] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:37.358898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:37.359511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:37.366382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:37.366678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:37.367456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:37.367901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:37.496907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:37.505135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e4bac1ee-0552-4056-b79a-9eb7dd7419f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150053 May 12 20:49:37.505734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 543/1115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:38.523530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:38.524116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:38.530745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:38.531190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:38.531943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:38.532369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:38.666251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:38.673601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b5cf3fb-9df7-49a0-8251-d30593ce84ed tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154145 May 12 20:49:38.674164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 573/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:39.691477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:39.692130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:39.698980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:39.699429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:39.700197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:39.700631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:39.833166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:39.841258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b33b821d-0937-43a8-ad6c-3efa3204c67d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153697 May 12 20:49:39.841855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 544/1117] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:40.859247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:40.859855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:40.867157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:40.867594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:40.868355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:40.868784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:41.005922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:41.014932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd7a5f79-9668-4a65-be85-63c4212667c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.159554 May 12 20:49:41.015853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 574/1118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:41.491400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:49:41.492014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:49:42.034878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:42.035495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:42.042833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:42.043299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:42.044212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:42.044659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:42.176279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:42.184108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4604a3eb-6f94-440f-aeb8-c8dce3e19d5d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154660 May 12 20:49:42.185507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 545/1119] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:43.201393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:43.201943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:43.208172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:43.208615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:43.209945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:43.210389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:43.345413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:43.353908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-345e29c4-ff94-4600-ba87-d7435b7cc22a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156399 May 12 20:49:43.354492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 575/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:44.373052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:44.373698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:44.379765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:44.380220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:44.380987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:44.382201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:44.510229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:44.517676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6a21fd02-f18b-4ad9-a54b-fb67e62a27d0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148472 May 12 20:49:44.518237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 546/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:45.535516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:45.536153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:45.543252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:45.543700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:45.544646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:45.545078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:45.678964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:45.686908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-488a98cf-3439-45c9-b060-251a5ab2e248 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155202 May 12 20:49:45.687575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 576/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:46.703932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:46.704578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:46.711694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:46.712143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:46.712906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:46.713377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:46.845057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:46.852509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-71092292-3360-472a-b1db-9c5da3cdbb82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152473 May 12 20:49:46.853072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 547/1123] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:47.869884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:47.870513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:47.876817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:47.877258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:47.878043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:47.878483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:48.007230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:48.014766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9c6196e7-4edd-4478-a4f6-0693adf79285 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148962 May 12 20:49:48.015326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 577/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:49.032505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:49.033128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:49.040201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:49.040654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:49.041456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:49.041891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:49.168485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:49.175840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-40a830e8-8be8-4601-9d19-e727f0e4891a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.147258 May 12 20:49:49.176403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 548/1125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:50.194567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:50.195285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:50.201986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:50.202434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:50.203194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:50.203627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:50.339650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:50.347089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6afb1cb6-9d9e-4b5f-8430-cb72effa185c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157784 May 12 20:49:50.347644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 578/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:51.365945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:51.366565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:51.372913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:51.373400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:51.374175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:51.374663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:51.505250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:51.513165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8cc435dc-733e-4955-843b-103fc8f2f6e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151743 May 12 20:49:51.513780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 549/1127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:52.530607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:52.531209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:52.537614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:52.537979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:52.538849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:52.539282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:52.667992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:52.675278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e661e64a-07ae-469e-92bf-662fbc4b8437 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.148631 May 12 20:49:52.675832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 579/1128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:53.692152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:53.692760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:53.699777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:53.700222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:53.700981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:53.701446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:53.841063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:53.848471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4fd24b06-e752-4090-9f87-0e730cd4aa11 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160175 May 12 20:49:53.849028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 550/1129] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:54.866945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:54.867559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:54.873917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:54.874370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:54.875131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:54.875570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:55.004719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:55.013047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-427d70d5-c9b4-4b68-bda9-d1d10cceb49e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149961 May 12 20:49:55.013652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 580/1130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:55.929556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:49:55.930166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:49:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:49:56.030840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:56.031430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:56.038009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:56.038459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:56.039254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:56.039674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:56.172146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:56.180215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6946455a-eed5-4afa-a8fb-ff69d645a322 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153457 May 12 20:49:56.180774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 551/1131] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:57.198364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:57.198978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:57.205025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:57.205509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:57.206273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:57.206708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:57.339955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:57.347386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd51d488-65e7-49e9-b9ca-7d1509aba9ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154054 May 12 20:49:57.347947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 581/1132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:58.365583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:58.366206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:58.372775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:58.373217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:58.374006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:58.374438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:58.508473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:58.515968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b821443f-1d4f-486f-b8ba-122ae717d91e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154697 May 12 20:49:58.516531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 552/1133] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:49:59.533819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:49:59.534363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:49:59.541328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:59.541784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:59.542549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:49:59.542985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:49:59.673015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:49:59.681075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af2f66ac-af6d-4c4e-807c-dfa8188aa96b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151244 May 12 20:49:59.683129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 582/1134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:49:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:00.698428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:00.699116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:00.705520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:00.705970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:00.706732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:00.707161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:00.840801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:00.848200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-11130c4d-f056-466e-a7d7-5aea44833cdf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153847 May 12 20:50:00.848763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 553/1135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:01.866518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:01.867151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:01.873505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:01.874203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:01.874710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:01.875142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:02.010125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:02.017428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-32afa4cf-e970-434b-bd3a-31f97e5247ce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155446 May 12 20:50:02.017993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 583/1136] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:03.034606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:03.035214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:03.041557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:03.042002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:03.042840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:03.043282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:03.174988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:03.183228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1b0ef76b-cb49-42e0-8f6b-2dffdbdc6596 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152498 May 12 20:50:03.183788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 554/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:04.200047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:04.200586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:04.206931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:04.207380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:04.208146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:04.209657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:04.342285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:04.350369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a4bfb66f-caea-46f6-90e8-cc140a5bebfc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154404 May 12 20:50:04.350945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 584/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:05.368447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:05.369056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:05.375396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:05.375847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:05.376602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:05.377041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:05.506211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:05.513954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8a1b076b-7113-4a78-affc-f916d52cd7aa tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150352 May 12 20:50:05.514514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 555/1139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:06.531380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:06.532041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:06.538337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:06.548398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:06.548398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:06.548398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:06.689459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:06.698134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-35bfc63f-3f56-4b9a-ae98-d870af1843ab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.170633 May 12 20:50:06.698708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 585/1140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:07.715732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:07.716346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:07.722678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:07.723125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:07.723890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:07.724326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:07.859048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:07.866696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3f132404-c39e-478d-8a10-d31d84340c76 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154900 May 12 20:50:07.867260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 556/1141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:07 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:08.884652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:08.885261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:08.891615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:08.892056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:08.892818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:08.893253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:09.022683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:09.030203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-785b3549-4f11-4ef9-b599-42e7b6e8796f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150445 May 12 20:50:09.030767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 586/1142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:10.047320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:10.047923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:10.054277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:10.054736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:10.055508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:10.055950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:10.246340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:10.254065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-febac8c9-f93b-4340-808d-06e76be3ca46 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.210634 May 12 20:50:10.254644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 557/1143] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:11.272011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:11.273623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:11.280122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:11.280573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:11.281353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:11.281789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:11.409910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:11.417893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9f6525fa-4155-4176-80bd-c6df7e95ae59 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149763 May 12 20:50:11.418793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 587/1144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:12.435499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:12.436101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:12.442685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:12.443132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:12.443898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:12.444327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:12.581113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:12.588539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1cb2d7dd-b928-45fc-9077-ebbf83599321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157145 May 12 20:50:12.589098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 558/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:13.606828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:13.607473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:13.613829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:13.614273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:13.615622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:13.615622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:13.747947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:13.755226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-218e00ee-ef1d-4591-bc3c-d0a3d0044b57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152431 May 12 20:50:13.755789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 588/1146] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:14.773522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:14.774158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:14.780142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:14.780564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:14.781349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:14.781788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:14.911270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:14.918965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c588499b-2c69-4c46-b4d1-0228304c1eb9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149634 May 12 20:50:14.919532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 559/1147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:15.935315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:15.935857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:15.942210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:15.942652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:15.943413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:15.943844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:16.079280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:16.089653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ead9774e-5608-4a2c-bc4e-4e64f95819a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158211 May 12 20:50:16.090246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 589/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:17.109140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:17.109786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:17.116214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:17.116606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:17.117435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:17.117878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:17.247239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:17.254579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1941ad42-bb3a-4c12-8ccc-b7e3152eadaf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.149400 May 12 20:50:17.255143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 560/1149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:18.272454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:18.273075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:18.280397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:18.280852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:18.281654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:18.282139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:18.425806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:18.434140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d44ef06-d887-4117-9b0f-05d3eae2b2c7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.165691 May 12 20:50:18.434735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 590/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:19.452804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:19.453512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:19.459374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:19.459818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:19.460581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:19.461013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:19.858142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:19.865697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df1ef3a3-cabf-4603-bf6c-8d553b513c73 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.418156 May 12 20:50:19.866264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 561/1151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:20.883086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:20.883965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:20.890318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:20.890792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:20.891572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:20.892015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:21.024873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:21.032476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c34464de-66f0-499e-b3e2-411a2d18e611 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153403 May 12 20:50:21.033059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 591/1152] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:22.050468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:22.051014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:22.058027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:22.058477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:22.059249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:22.059686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:22.193053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:22.200875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aae113db-e9f5-48d3-9a19-b8496044147b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154416 May 12 20:50:22.201458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 562/1153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:23.218892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:23.219471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:23.225885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:23.226336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:23.227112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:23.227547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:23.361187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:23.368713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-86b185e9-5eb2-48d5-92cf-a46f8681e33a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153724 May 12 20:50:23.370283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 592/1154] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:24.387517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:24.388182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:24.394735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:24.395189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:24.395964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:24.396401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:24.531298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:24.538689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-85b5191f-ddf1-4f35-b338-9320042536b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155989 May 12 20:50:24.539245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 563/1155] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:25.558906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:25.559597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:25.566536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:25.566978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:25.567749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:25.568181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:25.727831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:25.736037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f8ca602d-9848-46da-8fdc-02fec94eefc3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.181637 May 12 20:50:25.736617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 593/1156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:26.755014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:26.755623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:26.762505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:26.762948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:26.763720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:26.764155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:26.902445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:26.910080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-72e1aa6e-cb0e-4297-aa88-78bf438357d6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158911 May 12 20:50:26.910654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 564/1157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:27.928332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:27.928925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:27.936405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:27.936869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:27.937698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:27.938142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:28.090768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:28.098710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bbcc2b30-a900-486b-98ad-32171167a0e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.174369 May 12 20:50:28.099293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 594/1158] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:29.119583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:29.120232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:29.126747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:29.127200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:29.127982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:29.128424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:29.289905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:29.298623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9fec1268-375a-4f69-b524-572bea7f37cd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.183079 May 12 20:50:29.299369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 565/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:29 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:30.327784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:30.328411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:30.335118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:30.335572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:30.336608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:30.337056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:30.487908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:30.495861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1fec6b36-c6e9-49fb-a50d-aff11a7dce5c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.172045 May 12 20:50:30.496477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 595/1160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:31.517606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:31.518736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:31.530846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.531681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:31.533128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.534017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:31.550767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:31.551410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:31.558325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.558784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:31.559581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.560021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:31.589722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:50:31.698857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:31.706316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5f63efa1-e8d0-4a17-8d2a-2af95364b9a7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.195961 May 12 20:50:31.706888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 566/1161] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:31.943763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-604f42ce-c08c-46c3-95d4-ce8052a14a83 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 204 len: 0 microversion: 2.1 time: 0.396795 May 12 20:50:31.944375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 596/1162] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:50:31 2022] DELETE /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 20:50:31.952736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:31.953422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:31.959647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.960095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:31.960878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:31.961344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:32.107710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:32.116083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2272eaf0-bd4d-4a06-9ea3-15a7c49f3ced tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1684 microversion: 2.1 time: 0.167078 May 12 20:50:32.116582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 567/1163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:31 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:32.724712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:32.725581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:32.732563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:32.733009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:32.734001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:32.734432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:32.873822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:32.881375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-97eed827-b374-49d9-81a0-723e84c04f32 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160861 May 12 20:50:32.881966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 597/1164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:33.136855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:33.142577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:33.145534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:33.145986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:33.146763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:33.147203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:33.262641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:33.270090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-10033c74-bc0f-4f8e-bff7-40b863cabbd8 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1616 microversion: 2.1 time: 0.139702 May 12 20:50:33.270657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 568/1165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:33 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1616 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:33.670391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-8da12fde-1836-4c7d-beb2-29f03a7e051a req-1667b1b8-1ea8-41b3-9956-ab31b92f1175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f740839-8a3c-4567-8b6f-9256a71e0115", "name": "network-vif-deleted", "tag": "993d4c9a-8b2a-495e-982e-397e271acecb"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:50:33.690315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-8da12fde-1836-4c7d-beb2-29f03a7e051a req-1667b1b8-1ea8-41b3-9956-ab31b92f1175 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:33.690985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-8da12fde-1836-4c7d-beb2-29f03a7e051a req-1667b1b8-1ea8-41b3-9956-ab31b92f1175 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:33.707750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-8da12fde-1836-4c7d-beb2-29f03a7e051a req-1667b1b8-1ea8-41b3-9956-ab31b92f1175 service nova] Creating event network-vif-deleted:993d4c9a-8b2a-495e-982e-397e271acecb for instance 6f740839-8a3c-4567-8b6f-9256a71e0115 on hv-cinder-81565 May 12 20:50:33.715697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-8da12fde-1836-4c7d-beb2-29f03a7e051a req-1667b1b8-1ea8-41b3-9956-ab31b92f1175 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210739 May 12 20:50:33.717023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 598/1166] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:50:33.899375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:33.900704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:33.908704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:33.909206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:33.910148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:33.910623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:34.072690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:34.080867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a5bede06-27bc-44fa-b593-1535381ed3ca tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.185694 May 12 20:50:34.081614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 569/1167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:34.288617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:34.289256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:34.296044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:34.296522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:34.297306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:34.297782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:34.332511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:34.332991 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:34.333476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lazy-loading 'fault' on Instance uuid 6f740839-8a3c-4567-8b6f-9256a71e0115 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:50:34.377195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606b53c6f60d45cf9e2c3e5c6c9cde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec19c8306c6439b9392248450d21ec9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:34.385605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-db990241-3bae-4806-9789-515542a6173b tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 200 len: 1421 microversion: 2.1 time: 0.101256 May 12 20:50:34.395443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 599/1168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:34 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:35.099116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:35.099730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:35.107623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:35.108216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:35.109228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:35.109857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:35.257523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:35.265548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ecc1cf6a-3df6-4b27-990b-18f3ce1d66bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.171219 May 12 20:50:35.266138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 570/1169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:50:35.404000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:35.404597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:35.410925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:35.411381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:35.412159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:35.412597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:35.426074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 HTTP/1.1 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:50:35.427729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:50:35.429371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '6f740839-8a3c-4567-8b6f-9256a71e0115'} May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:50:35.430255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:50:35.432231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:50:35.433847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:50:35.433847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11655251-9ce2-4e04-ae1e-a5cd9cee87c2 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 404 len: 111 microversion: 2.1 time: 0.029944 May 12 20:50:35.433847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 600/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:35 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:50:35.438167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-da804e55-ff74-41ac-9cb3-5af40916ecc6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '.version_select at 0x7f4e62c5b4c0>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:35.550239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-da804e55-ff74-41ac-9cb3-5af40916ecc6 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448545032" status: 202 len: 0 microversion: 2.1 time: 0.115856 May 12 20:50:35.550832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 571/1171] 10.222.0.59 () {58 vars in 1220 bytes} [Thu May 12 20:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448545032 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:50:36.283632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:36.284268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:36.292835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:36.293320 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:36.294023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:36.294589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:36.446503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:36.456210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-94c377fe-23c1-4d96-83d9-be11014a273f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.176429 May 12 20:50:36.456828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 601/1172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:37.474506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:37.475128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:37.481512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:37.481975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:37.482759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:37.483199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:37.633145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:37.643594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-63ed4a46-ef6d-4fc6-be5d-c0afa658994b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.173411 May 12 20:50:37.644276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 572/1173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:38.663015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:38.663609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:38.670884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:38.671331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:38.672096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:38.672529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:38.808470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:38.816331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a5b08d71-ff83-4a81-8d6a-7dc9cd0dfd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157279 May 12 20:50:38.816919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 602/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:39.834082 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:39.834699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:39.841834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:39.842289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:39.843075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:39.843500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:39.989007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:39.996610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c1548ee9-dbd8-4cb9-970b-5b4ca9f86776 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166348 May 12 20:50:39.997180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 573/1175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:41.014150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:41.014760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:41.021460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:41.021912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:41.022681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:41.023114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:41.159408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:41.167502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d4e2ae1-d9f6-47f6-ac7b-4cc51bc8c855 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156614 May 12 20:50:41.168092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 603/1176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:42.184728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:42.185361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:42.191831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:42.192287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:42.193078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:42.193551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:42.337840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:42.345796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f8205949-e083-41f4-acc3-34d4f4c8dd1d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.165003 May 12 20:50:42.346418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 574/1177] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:43.363034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:43.363672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:43.370794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:43.371480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:43.372412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:43.372853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:43.509303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:43.517666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8818e385-a8c3-4ca0-8955-c5d2b1ccaf65 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158483 May 12 20:50:43.518249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 604/1178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:44.535062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:44.535704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:44.541821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:44.543039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:44.543845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:44.544282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:44.682289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:44.691666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bac121f5-ade0-4607-8e1f-82211b73155e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160614 May 12 20:50:44.692255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 575/1179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:45.708301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:45.708924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:45.715864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:45.716321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:45.717106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:45.717686 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:45.856992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:45.865449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f8e4444e-1945-4c06-a125-259ef20f3584 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160991 May 12 20:50:45.866035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 605/1180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:46.884033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:46.884890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:46.891244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:46.891693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:46.892609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:46.893045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:47.028356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:47.035836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-945ee660-9e62-4218-96ac-9ed34b83b0af tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.156124 May 12 20:50:47.036628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 576/1181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:48.053171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:48.053809 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:48.060925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:48.061417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:48.062194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:48.062633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:48.195195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:48.203319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9558806b-9b50-48bc-923d-d68f3fba143c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154113 May 12 20:50:48.204041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 606/1182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:49.221365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:49.222062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:49.228371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:49.228819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:49.229705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:49.230370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:49.373317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:49.380977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0cf9ac00-4dbb-49a2-8c13-b847d81ac2bd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.163595 May 12 20:50:49.381583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 577/1183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:50.403395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:50.403997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:50.410301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:50.410745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:50.411513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:50.411943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:50.543872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:50.551363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-85c5d89e-a49b-4f2a-adab-6d2948fe898d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.155912 May 12 20:50:50.551930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 607/1184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:51.568086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:51.568730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:51.575143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:51.575586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:51.576355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:51.576792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:51.718997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:51.726561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b24046d5-7723-4388-a8b7-7b40ab7733b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.162403 May 12 20:50:51.727127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 578/1185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:52.744620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:52.745301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:52.752395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:52.752835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:52.753660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:52.754098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:52.893753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:52.898914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-653a05d3-d5e3-46d3-a022-52a1a581ce28 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.158179 May 12 20:50:52.899493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 608/1186] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:53.917550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:53.918927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:53.925464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:53.925914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:53.926693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:53.927135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:54.077096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:54.085200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9711f628-7e4e-4bc8-ae15-af27a86e96c6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.172067 May 12 20:50:54.085825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 579/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:55.102754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:55.103374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:55.110019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:55.110476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:55.111243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:55.111718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:55.251918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:55.259626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dc8d3224-ef45-48b4-9129-802ef2ef0e19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160774 May 12 20:50:55.260187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 609/1188] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:56.276844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:56.278224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:56.284456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:56.284909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:56.285713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:56.286154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:56.419509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:56.426846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7fad1942-7c19-416f-8ab6-710f013d28e3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.153866 May 12 20:50:56.427407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 580/1189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:57.444622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:57.445254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:57.452261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:57.452732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:57.453560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:57.454004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:57.591008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:57.598704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-79dd45f5-bebd-4fba-8477-3b38c16844c9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157917 May 12 20:50:57.599327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 610/1190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:58.616017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:58.616662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:58.623554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:58.624004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:58.624768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:58.625204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:58.755530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:58.763252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b2020e23-3a2c-4fb7-af73-b9a27e84f281 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.151139 May 12 20:50:58.763817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 581/1191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:50:59.783799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:50:59.787267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:50:59.791575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:59.792026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:59.792853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:50:59.793400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:50:59.928958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:50:59.937641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e9ae79e9-bf25-45a1-9b26-a15ac2da7d9f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160588 May 12 20:50:59.938205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 611/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:50:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:00.955157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:00.955760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:00.962582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:00.963035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:00.963890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:00.964350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:01.110397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:01.118039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2ac9830b-dda0-4a45-92f9-9ea1d6cbe9b9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166825 May 12 20:51:01.118584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 582/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:02.136052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:02.136736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:02.143899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:02.144495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:02.145142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:02.145575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:02.289427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:02.298233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ddc0af54-4dec-45df-8153-c25ef1114ff4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166331 May 12 20:51:02.298802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 612/1194] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:03.319055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:03.319633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:03.327229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:03.327688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:03.328478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:03.328922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:03.472309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:03.480691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fcca0a67-a57f-4ac3-afba-73673a7eca8c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.167523 May 12 20:51:03.481410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 583/1195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:04.499192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:04.500091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:04.507173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:04.507617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:04.508406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:04.509108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:04.682087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:04.690569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-80132fc6-9861-46eb-bee2-f4dc59d600e1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.196146 May 12 20:51:04.691162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 613/1196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:05.707682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:05.708326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:05.714737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:05.720647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:05.720647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:05.720647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:05.848619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:05.856106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c3a91059-54e3-4b47-b7a6-d8272aab7231 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.152380 May 12 20:51:05.856836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 584/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:06.874562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:06.875202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:06.881756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:06.882206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:06.882969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:06.883414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:07.013198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:07.020488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9d5ad19d-681d-4a2f-a96d-44c2a941356a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.150393 May 12 20:51:07.021058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 614/1198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:08.037648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:08.038249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:08.045335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:08.045792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:08.046563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:08.047003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:08.197023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:08.207750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eceddf5e-6195-4e25-93ee-2ec17946373f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.174033 May 12 20:51:08.208343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 585/1199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:09.225434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:09.226056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:09.233355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:09.233812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:09.234590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:09.235024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:09.375473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:09.383183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6ed6f355-0bce-47d5-b09d-352c78547006 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.161725 May 12 20:51:09.384028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 615/1200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:10.402238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:10.402868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:10.410251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:10.410700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:10.411484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:10.411925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:10.550222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:10.557610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d4cf1836-3412-4222-80bb-154585990d3f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.160614 May 12 20:51:10.558107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 586/1201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:11.574721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:11.576215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:11.582976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:11.583426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:11.584209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:11.584667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:11.733970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:11.743421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ca518702-bba7-4aea-8458-69b264061fab tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.172688 May 12 20:51:11.744002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 616/1202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:12.761740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:12.762378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:12.768930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:12.769428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:12.770213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:12.770645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:12.925356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:12.933201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-64b1990c-15d3-4ab5-ac0b-34d672a20b2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.175679 May 12 20:51:12.933850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 587/1203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:13.953322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:13.953860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:13.960192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:13.960644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:13.961441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:13.961874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:14.105328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:14.112878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eb5aefff-1d68-43e6-a72d-f64f2e4c9d48 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.165140 May 12 20:51:14.113479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 617/1204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:15.131415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:15.131982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:15.138730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:15.139443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:15.140226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:15.140384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:15.299814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:15.308252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a1e90f7b-0bf7-4bda-8468-75f85f80092c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.181427 May 12 20:51:15.308844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 588/1205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:16.326385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:16.327023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:16.333406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:16.333851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:16.334620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:16.335048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:16.479782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:16.487724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-05b6331e-4812-4e37-859c-4aa73ee75d3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.165269 May 12 20:51:16.488317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 618/1206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:17.505256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:17.507811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:17.513589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:17.514036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:17.514812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:17.515242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:17.664894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:17.676282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-097d9992-dda4-4415-8bc7-334cc16da953 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.175012 May 12 20:51:17.677084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 589/1207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:18.696335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:18.696998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:18.704344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:18.704799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:18.705618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:18.706054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:18.859877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:18.869454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-37814520-54bc-4bbe-aa5c-bdcb99dccdf4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.177279 May 12 20:51:18.870040 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 619/1208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:19.890662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:19.892286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:19.899477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:19.899938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:19.900757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:19.901191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:20.084265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:20.098402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53c25e64-e9c9-412e-ae31-984e832d37f8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.212092 May 12 20:51:20.099002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 590/1209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:21.117011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:21.117771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:21.126557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:21.127002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:21.127784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:21.128218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:21.292710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:21.307012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f48604d8-6566-44f0-90c8-9c69b16479b7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.193571 May 12 20:51:21.308074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 620/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:22.331800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:22.332402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:22.338954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:22.339406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:22.340237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:22.340677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:22.485802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:22.493561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b05ccf41-e5a6-4ac5-9cf8-c91320ca6836 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.165555 May 12 20:51:22.494295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 591/1211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:23.513172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:23.514136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:23.520886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:23.521370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:23.522165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:23.522645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:23.693202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:23.702915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-19de3a0d-f192-4e09-b7f2-4e07bd98726d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.194089 May 12 20:51:23.703533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 621/1212] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:24.727488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:24.728137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:24.736786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:24.737228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:24.738059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:24.738494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:24.903301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:24.911555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c973bda5-2f82-4ed2-9efd-38ddbe9c4941 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.190342 May 12 20:51:24.912142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 592/1213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:25.930970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:25.931653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:25.939531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:25.939983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:25.940757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:25.941190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:26.116113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:26.125305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9bd30b0b-b81e-4949-bcaa-f11404c735b6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.198551 May 12 20:51:26.125890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 622/1214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:26.441113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:26.442027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:26.454400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:26.455191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:26.456581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:26.457439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:27.145504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:27.146280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:27.152750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:27.153494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:27.154033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:27.154473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:27.289784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:27.298679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2c5de570-8ea7-4b17-ac55-0cbe6fe5efc4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.157040 May 12 20:51:27.299265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 623/1215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:27.370939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:51:27.371237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:51:28.321806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:28.322936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:28.334201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:28.334984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:28.336052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:28.336491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:28.470997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:28.478634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bf35960f-3297-4156-b66b-b74320a8c25e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.163908 May 12 20:51:28.479205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 624/1216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:29.496050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:29.496736 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:29.503208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:29.503645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:29.504418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:29.504854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:29.658947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:29.667337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-efd8f36f-358c-4c86-8f75-638388583f3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.175110 May 12 20:51:29.667989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 625/1217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:29 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:30.685817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:30.686711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:30.693018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:30.693497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:30.694275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:30.694714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:30.860758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:30.872059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0aba2fc0-05d5-42ab-808b-7493dc0cec54 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.190025 May 12 20:51:30.872996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 626/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:31.895958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:31.896597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:31.903882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:31.904354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:31.905123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:31.905592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:32.051475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:32.059463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-00a4c410-8dd6-4d91-9a4a-5b3bc1d06353 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.167199 May 12 20:51:32.060245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 627/1219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:33.077159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:33.077919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:33.085265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:33.085760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:33.086553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:33.087070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:33.249203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:33.257405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1eadeff7-5ac0-4c51-9ba0-851b52a622bf tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.185086 May 12 20:51:33.257994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 628/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:34.281114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:34.281899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:34.289033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:34.289513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:34.290328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:34.290766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:34.449314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:34.457300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d4b959e5-8aa2-4f4f-885b-d2947b2958cb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.181347 May 12 20:51:34.457885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 629/1221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:34 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:35.482661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:35.483397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:35.490211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:35.490672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:35.491470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:35.491923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:35.630279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:35.638475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-41f44798-e9b0-4dcc-9ebf-772391bd58f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.159939 May 12 20:51:35.639351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 630/1222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:36.656318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:36.657004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:36.663345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:36.663784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:36.664536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:36.664968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:36.803646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:36.821545 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-690bc9cb-de55-45b1-b934-3237b218b60f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.169318 May 12 20:51:36.822152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 631/1223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:37.839375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:37.840463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:37.848688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:37.849188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:37.850212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:37.850756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:37.997921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:38.005695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b01f6e88-57d5-4c3c-a869-11e9506a314e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.170527 May 12 20:51:38.006279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 632/1224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:39.025294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:39.026477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:39.034398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:39.034853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:39.035627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:39.036064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:39.177855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:39.186699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b0fce06b-c4c7-4873-91ab-3f834d51f976 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.166236 May 12 20:51:39.191908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 633/1225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:40.204379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:40.205042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:40.211545 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:40.211995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:40.212755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:40.213192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:40.356597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:40.364423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af2b15e3-2379-481f-8e5b-18ba2b17bd2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.163887 May 12 20:51:40.365032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 634/1226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:41.382288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:41.382987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:41.390462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:41.390905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:41.391671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:41.392103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:41.534869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:41.542651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08875c97-6cbe-41a9-bccb-eb143a800cc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.164128 May 12 20:51:41.543795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 635/1227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:41.596762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:51:41.597477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:51:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 (ip 10.222.0.59) !!! May 12 20:51:42.561969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:42.562601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:42.569422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:42.569868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:42.570673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:42.571095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:42.710480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:42.718283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cd1a9e10-cc1c-41a6-8a88-92b6deb021c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.161389 May 12 20:51:42.718846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 636/1228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:43.736257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:43.736932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:43.744448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:43.744896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:43.745985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:43.746193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:43.921136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:43.930760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3919f49e-2806-4787-81a5-0575f2fe9e3b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.198604 May 12 20:51:43.931345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 637/1229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:44.948688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:44.950455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:44.956270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:44.956895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:44.958169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:44.958799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:45.134242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:45.143688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-180e25a5-d911-4b0c-8d94-ce0466f5c321 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.198900 May 12 20:51:45.144278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 638/1230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:46.167334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:46.168697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:46.179985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:46.180677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:46.181886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:46.182480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:46.349041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:46.357306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-64544e77-4459-42a6-b5d1-e0b990dab69d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.197242 May 12 20:51:46.357944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 639/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:47.376614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:47.377370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:47.385156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:47.385632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:47.387237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:47.387742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:47.539262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:47.548374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9d572050-5958-45a6-87c7-f8e973b7c86e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.176562 May 12 20:51:47.548977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 640/1232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:48.569026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:48.570178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:48.581192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:48.581745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:48.583202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:48.583662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:48.779856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:48.790116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f95bb83e-f0ca-4065-8d63-23068ace851b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.225791 May 12 20:51:48.791185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 641/1233] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:49.810666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:49.811399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:49.818664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:49.819116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:49.819911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:49.820357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:49.985440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:49.993629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e2ea79ae-1071-466b-8a1d-9ff897f50664 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.187550 May 12 20:51:49.994309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 642/1234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:51.013245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:51.013944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:51.019951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:51.020403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:51.021179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:51.021644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:51.160919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:51.171904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d850d706-8bcd-4fef-9dcd-670cfe2dbb30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.163191 May 12 20:51:51.172962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 643/1235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:52.192892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:52.193902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:52.205655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:52.206379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:52.207656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:52.208369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:52.388652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:52.396544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-680ac443-796b-4eea-8cfd-5a691be6e497 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.209783 May 12 20:51:52.397133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 644/1236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:53.413880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:53.414646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:53.422437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:53.422881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:53.423653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:53.424088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:53.577377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:53.585522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d351c21a-4a4d-40d1-9b86-ff32414ee6b0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.175797 May 12 20:51:53.586403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 645/1237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:54.603373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:54.604072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:54.610723 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:54.613863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:54.613863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:54.613863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:54.752616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:54.761607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-86f63593-5e28-48c9-95e9-196da058ac64 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.162156 May 12 20:51:54.762203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 646/1238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:55.780003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:55.780904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:55.788199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:55.788954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:55.790358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:55.791121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:55.947389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:55.955620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2def9a89-a33c-47a4-96a0-e5ee301b3a3d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.180436 May 12 20:51:55.956227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 647/1239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:51:56.973741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:56.974425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:56.980987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:56.981469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:56.982239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:56.982672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:57.115963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:57.124355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c1ff4d4a-e640-40d2-88b5-72a531ccd9de tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.154497 May 12 20:51:57.125540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 648/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:58.145857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:58.146957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:58.158132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:58.158899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:58.160233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:58.160988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:58.332136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:58.343343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-48eb1afa-248a-47e4-8275-10cfba476045 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.204394 May 12 20:51:58.343834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 649/1241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:51:59.361639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:51:59.362357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:51:59.370486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:59.370959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:59.371818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:51:59.372258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:51:59.518940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:51:59.527075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5484ac18-90f7-406f-821b-89202ee83952 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.168809 May 12 20:51:59.527641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 650/1242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:51:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:00.545506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:00.546554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:00.554275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:00.554724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:00.555506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:00.555942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:00.751489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:00.760051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6163841f-df65-4d93-ad5c-2f3b752abd2a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.218779 May 12 20:52:00.761329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 651/1243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:01.778164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:01.779295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:01.786153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:01.786923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:01.788213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:01.788987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:01.951623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:01.960343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d1488a57-7b2b-418a-8ce7-ea5432f30726 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.186924 May 12 20:52:01.960929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 652/1244] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:02.980143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:02.980862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:02.988200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:02.988662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:02.989503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:02.989962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:03.153745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:03.163858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e4fd82e2-ab19-406d-9f01-c20d31ccb009 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.188593 May 12 20:52:03.164451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 653/1245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:04.182876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:04.183873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:04.190531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:04.195204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:04.195204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:04.195204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:04.348878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:04.361058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-505affc5-8ccf-4390-820d-14cd565f65e7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.182751 May 12 20:52:04.362097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 654/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:05.383417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:05.384482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:05.394108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:05.394851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:05.396212 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:05.397033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:05.547287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:05.555420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-aa2ae5d1-a930-47af-83d0-77260047c156 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.179025 May 12 20:52:05.556021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 655/1247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:52:06.575198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:06.576283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:06.587532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:06.589454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:06.590802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:06.591562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:06.779187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:06.790993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-da6496f7-7a17-4bff-bf8b-9222a30f182a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.221468 May 12 20:52:06.792144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 656/1248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:07.811359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:07.812139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:07.823644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:07.824406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:07.825820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:07.826572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:07.999171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:08.007761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7b0264f0-dc3b-4ec4-9f7a-a27c4936ea0a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.202539 May 12 20:52:08.008342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 657/1249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:07 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:52:09.028901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:09.029699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:09.038353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:09.039121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:09.040466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:09.041268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:09.228411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:09.236658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-710ee625-7e58-4419-854c-9e87f686dc78 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.214471 May 12 20:52:09.237335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 658/1250] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:10.257560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:10.258498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:10.266249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:10.266721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:10.267521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:10.267957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:10.461587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:10.474120 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc49c03d-a94b-48f6-bf09-044edca6707c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.221021 May 12 20:52:10.475165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 659/1251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:11.501704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:11.502851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:11.513556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:11.514015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:11.514813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:11.515252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:11.694825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:11.708610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a4549cb0-507a-4cdf-b108-c8c9da1c4c96 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.213421 May 12 20:52:11.709713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 660/1252] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:12.736331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:12.736995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:12.746022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:12.746490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:12.747647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:12.748152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:12.945142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:12.957971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d5d5572e-5567-472d-8305-a23e1e4ec810 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.226596 May 12 20:52:12.963074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 661/1253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:13.979267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:13.980351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:13.991546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:13.992277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:13.999662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:13.999662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:14.169682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:14.182771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1938d3cc-38ec-40b2-9572-8a10b7030995 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.208568 May 12 20:52:14.183679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 662/1254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:52:15.205035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:15.205808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:15.214161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:15.214644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:15.215430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:15.215870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:15.378711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:15.387096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1fa8f248-01fe-47b0-8f7f-1d9b5a3474a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.187956 May 12 20:52:15.387684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 663/1255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:16.408566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:16.409653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:16.419351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:16.427179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:16.432047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:16.432509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:16.598049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:16.607808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b4c5a13d-ece4-43ad-baa6-b45dd95d7e33 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.205626 May 12 20:52:16.608394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 664/1256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:17.624196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:17.625448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:17.631810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:17.632272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:17.633083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:17.633550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:17.824478 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:17.832400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cc6742c7-e8d5-429c-a31f-3bd0f4a826a5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.212080 May 12 20:52:17.832995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 665/1257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:18.997704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:18.998504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:19.005186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:19.005667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:19.008062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:19.008523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:19.038100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Going to try to terminate instance {{(pid=129358) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 20:52:19.362165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9eeafe37-f0d1-49bd-9ac8-1feef1f8f78b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 204 len: 0 microversion: 2.1 time: 0.367794 May 12 20:52:19.363239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 666/1258] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:52:18 2022] DELETE /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 20:52:19.371023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-cb8e304d-f989-4173-bfda-69e178dff1a0 req-c90e2055-61cb-4747-9c64-a9efc1a76767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:52:19.379444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-cb8e304d-f989-4173-bfda-69e178dff1a0 req-c90e2055-61cb-4747-9c64-a9efc1a76767 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:19.380061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-cb8e304d-f989-4173-bfda-69e178dff1a0 req-c90e2055-61cb-4747-9c64-a9efc1a76767 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:19.391980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-cb8e304d-f989-4173-bfda-69e178dff1a0 req-c90e2055-61cb-4747-9c64-a9efc1a76767 service nova] Creating event network-changed:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:52:19.397121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-cb8e304d-f989-4173-bfda-69e178dff1a0 req-c90e2055-61cb-4747-9c64-a9efc1a76767 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032226 May 12 20:52:19.397758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 667/1259] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:52:19.404616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:19.405371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:19.412119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:19.414155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:19.414155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:19.414155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:19.647099 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:19.662687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0c208795-0848-4b36-87b1-9e22ac9c932e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1570 microversion: 2.1 time: 0.263288 May 12 20:52:19.667363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 668/1260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1570 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:52:20.687886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:20.688968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:20.699987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:20.700533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:20.701343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:20.701790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:20.863926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:20.872830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-459b5b5e-19aa-45ea-998c-b5d448fcd0ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.193671 May 12 20:52:20.873452 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 669/1261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:21.890324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:21.891072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:21.898370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:21.898818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:21.899605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:21.900531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:22.058525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:22.067115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7f49f967-c002-4b81-a075-ef91203e8f92 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.180552 May 12 20:52:22.068052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 670/1262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:52:23.086522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:23.087573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:23.096384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:23.096957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:23.098406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:23.098870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:23.306490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:23.314744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ac6cc470-100e-4942-be99-aa7282397dc8 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.232131 May 12 20:52:23.315585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 671/1263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:24.338441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:24.339501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:24.346256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:24.346707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:24.347511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:24.347954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:24.505547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:24.515348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91000b34-0cca-4927-a98b-1c0e5d07a4ec tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.180902 May 12 20:52:24.515951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 672/1264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:25.537978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:25.538835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:25.546672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:25.547155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:25.547983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:25.548425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:25.717119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:52:25.725780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b09e88e6-1770-4d0b-9ec6-f4e25c7a842f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.191977 May 12 20:52:25.726574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 673/1265] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:52:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:52:26.467470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:52:26.468206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:52:26.475585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:26.476044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:26.476881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:52:26.477583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:52:30.749073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:52:30.967441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:53:01.500202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:53:01.501778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:53:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 (ip 10.222.0.59) !!! May 12 20:53:12.358065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 12 20:53:12.358732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 (ip 10.222.0.59) !!! May 12 20:53:15.938105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:53:15.938708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:53:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 (ip 10.222.0.59) !!! May 12 20:53:26.988624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6d6d33a3-a9c2-49fb-876c-daf355035939 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 202 len: 0 microversion: 2.1 time: 120.554963 May 12 20:53:26.992120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 593/1266] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:51:26 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 0 bytes in 120557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:53:27.003611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Request method failure captured: May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 HTTP/1.1 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXF-cqWmg2IeqVhpGWhcjfAE8jTJvOcTJ_OEPEQN0OkyHSFbAqMl_PvgUzcpf0jbhpIJEqU7ZSyUCnO7bUMaj1k4cho9hTdOa4sqKifPKUs0l7sqF9z51A3mdsPBI9LJWXQhWFMcqQ9M3gnzNIpIRw5IBj9nUrynFid5O6pSVi7TqKI May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:53:27.011422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fd3f403a1bdf48db8bec832b39b8f391", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: b4df001beaca4de2a8e15c26b31a9168 May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:53:27.013325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': '10ab3d9c-d609-4b71-98bf-2b56f872645d', 'id': 'ac664be6-91bb-4dba-813c-78b8f0936c93'} May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:53:27.014562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:53:27.016731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.022134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:53:27.026359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) May 12 20:53:27.029647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:53:27.031231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6479036-d6c5-4bc6-bb3c-a1e62e553e45) {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:53:27.031231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3129269d-5535-41de-83da-858d13a2af99 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 400 len: 269 microversion: 2.1 time: 60.563174 May 12 20:53:27.031231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 674/1267] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:52:26 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 269 bytes in 60565 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:53:27.037932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:53:27.037932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:53:27.053714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.053714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.053714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.053714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.094522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:53:27.095325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:53:27.102477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.107913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.107913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.107913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.287661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:53:27.299966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-74502527-64b5-47f8-9311-216d407b71e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.309222 May 12 20:53:27.300569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 594/1268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:53:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:53:27.306434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:53:27.307107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:53:27.313867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.314322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.315194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.315742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.332504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:53:27.334445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:53:27.337127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:53:27.338733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:53:27.340742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:53:27.343784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:53:27.343784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fca5c320-5b52-48f8-8ab0-e9b9df35e437 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.034516 May 12 20:53:27.343784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 595/1269] 10.222.0.59 () {60 vars in 1279 bytes} [Thu May 12 20:53:27 2022] DELETE /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:53:27.343784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:53:27.343784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:53:27.350012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.350459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:53:27.351237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:53:27.351671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:54:31.394316 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:54:31.642558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:54:47.383261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:54:47.384090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 (ip 10.222.0.59) !!! May 12 20:55:10.702784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:55:10.703655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:55:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 (ip 10.222.0.59) !!! May 12 20:55:27.332472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Request method failure captured: May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 HTTP/1.1 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXF-cqWmg2IeqVhpGWhcjfAE8jTJvOcTJ_OEPEQN0OkyHSFbAqMl_PvgUzcpf0jbhpIJEqU7ZSyUCnO7bUMaj1k4cho9hTdOa4sqKifPKUs0l7sqF9z51A3mdsPBI9LJWXQhWFMcqQ9M3gnzNIpIRw5IBj9nUrynFid5O6pSVi7TqKI May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:55:27.335412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fd3f403a1bdf48db8bec832b39b8f391", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: b4df001beaca4de2a8e15c26b31a9168 May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:55:27.336911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': '10ab3d9c-d609-4b71-98bf-2b56f872645d', 'id': 'ac664be6-91bb-4dba-813c-78b8f0936c93'} May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:55:27.338899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:55:27.340331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.342036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:55:27.343430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) May 12 20:55:27.345127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:55:27.346854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fbf23c15-b47c-4b6e-aa67-f6aa77f03e34) {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:55:27.346854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3b9c9b7f-8cc7-48d3-a6de-86bfeca8fe37 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 400 len: 269 microversion: 2.1 time: 119.999238 May 12 20:55:27.346854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 596/1270] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:53:27 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 269 bytes in 120001 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:55:27.346854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:55:27.347228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:55:27.352292 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.352751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.353632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.354138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.388941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-25c6380e-a135-4e46-a0ae-183f5c7c8d2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2" status: 202 len: 0 microversion: 2.1 time: 120.361732 May 12 20:55:27.393123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 675/1271] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:53:27 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 => generated 0 bytes in 120367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:55:27.464412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:55:27.465389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:55:27.472278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.479229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.479229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.479229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.489123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:55:27.490834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:55:27.493988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:55:27.495365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:55:27.496956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:55:27.500294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:55:27.500294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b549b514-0a05-4168-b291-85bb7e461a9b tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.100245 May 12 20:55:27.500294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 676/1272] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:55:27 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:55:27.500294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:55:27.500294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:55:27.504958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.505457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.506254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.506696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.519857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:55:27.528310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1e9b32ea-4475-469e-82f8-f6b161bafb8e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.188862 May 12 20:55:27.528893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 597/1273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:55:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:55:27.533614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:55:27.534110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:55:27.539936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.540965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:55:27.541779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:55:27.542226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:21.510213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:56:21.510998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:56:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 (ip 10.222.0.59) !!! May 12 20:56:31.861254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:31.909836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:32.018228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 HTTP/1.1 May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:56:32.021487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': 'c5583a9e-213d-4250-afa6-8a77981ef335', 'id': 'b2c7843a-fd65-4f95-b0c0-20e9c77334c2'} May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.024402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.025871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.027149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.028273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) May 12 20:56:32.030067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.031393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-73d07d17-810b-494a-946d-a8502a3c3dfe) {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.031393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a9b5debe-8c74-4d21-a793-7036eb3d480a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2" status: 400 len: 269 microversion: 2.1 time: 64.529240 May 12 20:56:32.031393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 677/1274] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:55:27 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 => generated 269 bytes in 64530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.031393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.031768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.038219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.038817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.039717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.040163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.060382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Request method failure captured: May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 HTTP/1.1 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXF-cqWmg2IeqVhpGWhcjfAE8jTJvOcTJ_OEPEQN0OkyHSFbAqMl_PvgUzcpf0jbhpIJEqU7ZSyUCnO7bUMaj1k4cho9hTdOa4sqKifPKUs0l7sqF9z51A3mdsPBI9LJWXQhWFMcqQ9M3gnzNIpIRw5IBj9nUrynFid5O6pSVi7TqKI May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:56:32.063117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fd3f403a1bdf48db8bec832b39b8f391", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: b4df001beaca4de2a8e15c26b31a9168 May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.064566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': '10ab3d9c-d609-4b71-98bf-2b56f872645d', 'id': 'ac664be6-91bb-4dba-813c-78b8f0936c93'} May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.065223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.066332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.069233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.071877 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) May 12 20:56:32.074604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.077645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-be446f10-9dc1-4c78-91d3-656722bf7858) {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.077645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-619a9d02-e724-4016-9e70-04e1abaecb4c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 400 len: 269 microversion: 2.1 time: 64.534758 May 12 20:56:32.077645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 598/1275] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:55:27 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 269 bytes in 64536 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.077645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.078282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.081840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.081840 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.083205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.083602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.105029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:56:32.106816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.108639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.110521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.112057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.113580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.113580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4feec454-eae2-42c1-8932-8979246e777d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.041556 May 12 20:56:32.113580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 599/1276] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.114284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.114763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.122080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.122080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.122529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.122930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.200669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:32.209320 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-75058d6a-35f0-47e0-b7ff-840332f0fe90 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1451 microversion: 2.1 time: 0.184768 May 12 20:56:32.210839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 678/1277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1451 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:32.215905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.216395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.221776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:32.222580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.223146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.224042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.224478 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.283162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 HTTP/1.1 May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:56:32.285752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.287539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': 'c5583a9e-213d-4250-afa6-8a77981ef335', 'id': 'b2c7843a-fd65-4f95-b0c0-20e9c77334c2'} May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.288428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.289595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.290782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.291920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) May 12 20:56:32.294335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.298437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e02ba546-a4a1-4fa6-b943-ae2d06c13a99) {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.299600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9d06595d-1753-4c9a-89a8-6f97844b2c78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2" status: 400 len: 269 microversion: 2.1 time: 0.189813 May 12 20:56:32.300212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 600/1278] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:56:32 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 => generated 269 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.307232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.307915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.315668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.316554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.318758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.319370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.345033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:32.367832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:56:32.367996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad (ip 10.222.0.59) !!! May 12 20:56:32.404038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Request method failure captured: May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 HTTP/1.1 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXF-cqWmg2IeqVhpGWhcjfAE8jTJvOcTJ_OEPEQN0OkyHSFbAqMl_PvgUzcpf0jbhpIJEqU7ZSyUCnO7bUMaj1k4cho9hTdOa4sqKifPKUs0l7sqF9z51A3mdsPBI9LJWXQhWFMcqQ9M3gnzNIpIRw5IBj9nUrynFid5O6pSVi7TqKI May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:56:32.406374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fd3f403a1bdf48db8bec832b39b8f391", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: b4df001beaca4de2a8e15c26b31a9168 May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.408083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': '10ab3d9c-d609-4b71-98bf-2b56f872645d', 'id': 'ac664be6-91bb-4dba-813c-78b8f0936c93'} May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.408923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.410201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.412584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.413852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) May 12 20:56:32.415221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.416497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b0853c8c-1b76-420a-a439-ac304bcdb4db) {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.416497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bf21aeff-2433-48eb-ac02-1355b4324221 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 400 len: 269 microversion: 2.1 time: 0.195774 May 12 20:56:32.416497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 679/1279] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:56:32 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 269 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.416497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.416868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.421570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.422018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.422781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.423213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.438625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:56:32.440175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.444104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.445738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.447460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.450914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.450914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c269dc5e-4efb-45d0-81be-b416c1a95a43 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.032342 May 12 20:56:32.450914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 680/1280] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.450914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.450914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.453976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.454403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.455195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.455608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.550778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:32.552716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:32.561379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0ab9cbcc-d00a-4808-b77f-02d41e529507 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1445 microversion: 2.1 time: 0.259498 May 12 20:56:32.562628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 601/1281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1445 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:32.567993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.568373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.582173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.582912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.583871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.584354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.616849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 HTTP/1.1 May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:56:32.619137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 20:56:32.620658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': 'c5583a9e-213d-4250-afa6-8a77981ef335', 'id': 'b2c7843a-fd65-4f95-b0c0-20e9c77334c2'} May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.622043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.623299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.624738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.626290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) May 12 20:56:32.627651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.628876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eadf502f-6c9f-41f8-8e5a-0c66aa1a0582) {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.628876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f49b5f51-2c5e-4eae-a961-55cdba8af862 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2" status: 400 len: 269 microversion: 2.1 time: 0.177133 May 12 20:56:32.628876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 681/1282] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:56:32 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.628876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.630934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.633497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.633954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.635180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.636118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.673062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lazy-loading 'services' on Instance uuid 10ab3d9c-d609-4b71-98bf-2b56f872645d {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:32.715388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:32.724937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4107600e-1a2b-451c-a61b-f9b6b105a0c0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1377 microversion: 2.1 time: 0.102574 May 12 20:56:32.725574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 682/1283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1377 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:32.740428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.741338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: 280983fe-4f61-41a6-b6db-4cfa7ac32703] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.748451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.749247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.750091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.750535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.769099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.771565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 HTTP/1.1 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Openstack-Nova-Api-Version: 2.20 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:56:32.773239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.774853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '280983fe-4f61-41a6-b6db-4cfa7ac32703'} May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.776222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. May 12 20:56:32.780834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:56:32.783552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance 280983fe-4f61-41a6-b6db-4cfa7ac32703 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.783552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-197f58c1-d553-4e3b-8edc-6d7e5e99aed1 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703" status: 404 len: 111 microversion: 2.20 time: 0.038690 May 12 20:56:32.783552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 683/1284] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 20:56:32 2022] GET /compute/v2.1/servers/280983fe-4f61-41a6-b6db-4cfa7ac32703 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Request method failure captured: May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 HTTP/1.1 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXF-cqWmg2IeqVhpGWhcjfAE8jTJvOcTJ_OEPEQN0OkyHSFbAqMl_PvgUzcpf0jbhpIJEqU7ZSyUCnO7bUMaj1k4cho9hTdOa4sqKifPKUs0l7sqF9z51A3mdsPBI9LJWXQhWFMcqQ9M3gnzNIpIRw5IBj9nUrynFid5O6pSVi7TqKI May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:56:32.784437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fd3f403a1bdf48db8bec832b39b8f391", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fd3f403a1bdf48db8bec832b39b8f391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: fd3f403a1bdf48db8bec832b39b8f391 May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1592398503 May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: b4df001beaca4de2a8e15c26b31a9168 May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-VolumesSnapshotTestJSON-1592398503-project May 12 20:56:32.786618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'server_id': '10ab3d9c-d609-4b71-98bf-2b56f872645d', 'id': 'ac664be6-91bb-4dba-813c-78b8f0936c93'} May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.787711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:56:32.789172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.790765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.792099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) May 12 20:56:32.804515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:56:32.806610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:32.806610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:32.806783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-81515456-c819-463d-9082-d0a8c174f1d9) {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:56:32.806783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-52748ef3-4369-4c37-bc4f-d0a777c3f37a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93" status: 400 len: 269 microversion: 2.1 time: 0.231571 May 12 20:56:32.807357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.807357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.807524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 602/1285] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:56:32 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d/os-volume_attachments/ac664be6-91bb-4dba-813c-78b8f0936c93 => generated 269 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:56:32.807610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.807610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.877750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d38838-7cd2-4f6f-a3a8-36148bd113ad", "name": "network-vif-deleted", "tag": "ab602ec5-28bc-4120-bf2f-4a7674dc2902"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 20:56:32.883300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:32.883745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:32.896111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] Creating event network-vif-deleted:ab602ec5-28bc-4120-bf2f-4a7674dc2902 for instance a2d38838-7cd2-4f6f-a3a8-36148bd113ad on hv-cinder-81565 May 12 20:56:32.899849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR oslo.messaging._drivers.impl_rabbit [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] [9347a406-75b0-42fe-ac4d-0e00a19b4755] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 20:56:33.226538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.objects.instance [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'services' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 20:56:33.908578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] [9347a406-75b0-42fe-ac4d-0e00a19b4755] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 34266. May 12 20:56:33.912605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-5c8bad4b-c7fb-4052-a854-4982f0a9f83b req-2e1d723c-4d3b-40a9-a8dd-ec06366c5573 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.115807 May 12 20:56:33.913363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 603/1286] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:56:33.918563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:33.919334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:33.925739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:33.926238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:33.927181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:33.927621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:33.993014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:34.000723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3807155a-a016-436b-86d6-e106b7dae887 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086252 May 12 20:56:34.001306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 604/1287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:35.018545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:35.019387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:35.026406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:35.026863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:35.027665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:35.028111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:35.091551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:35.099022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-03260956-5ed8-462f-b9d8-50afa3a7f42e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084452 May 12 20:56:35.099592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 605/1288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:35.947119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:56:35.947706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:56:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 (ip 10.222.0.59) !!! May 12 20:56:36.117062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:36.117781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:36.124240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:36.125853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:36.125853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:36.125853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:36.194821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:36.203721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d337ef6c-9125-4ed0-8e7e-ab2cddb9115b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.091144 May 12 20:56:36.204294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 606/1289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:37.221171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:37.221935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:37.229015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:37.229504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:37.230287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:37.230720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:37.296455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:37.304766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49c3a690-48ad-43ea-9fdb-4fb309774423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.087445 May 12 20:56:37.305353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 607/1290] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:38.321842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:38.322548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:38.328797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:38.329246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:38.330057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:38.330527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:38.393852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:38.402389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f1efa84c-a681-47fb-8602-72dfd8346683 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084958 May 12 20:56:38.402990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 608/1291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:39.428460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:39.429159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:39.436250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:39.436695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:39.437504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:39.437938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:39.500487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:39.508571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e67c9853-e708-44f9-8049-46cd117cfea5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083273 May 12 20:56:39.509141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 609/1292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:40.527025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:40.527745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:40.534145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:40.534598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:40.535370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:40.535806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:40.600801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:40.609045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5e7ca509-375c-4d51-86c8-637b1111f66d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086646 May 12 20:56:40.609632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 610/1293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:40 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:41.626153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:41.626850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:41.633074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:41.634139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:41.635466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:41.635902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:41.698838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:41.706277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ae808a33-393b-4082-8b52-b5c61b093264 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083911 May 12 20:56:41.706833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 611/1294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:42.722582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:42.723268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:42.730024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:42.730473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:42.731232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:42.731662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:42.796010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:42.803773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cb205391-6818-46d5-b314-560fc03a8381 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085048 May 12 20:56:42.804430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 612/1295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:43.821040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:43.821854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:43.829448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:43.829900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:43.830669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:43.831106 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:43.894584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:43.902705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-965ccca9-3b05-43d9-9cb9-62f8e6ee7bfd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085503 May 12 20:56:43.903284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 613/1296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:44.919950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:44.920624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:44.927520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:44.927962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:44.928730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:44.929167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:44.993846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:45.002516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ee4e49ba-a510-4a80-bd35-1323fdda0c79 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.087512 May 12 20:56:45.003157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 614/1297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:46.020208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:46.020902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:46.027820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:46.028277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:46.029038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:46.029497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:46.103210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:46.113891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-10ae657d-7f66-496c-a511-71fad29bc0e5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.097199 May 12 20:56:46.114921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 615/1298] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:47.132415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:47.133105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:47.141075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:47.141548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:47.142311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:47.142767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:47.205127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:47.212706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ffd17c03-b7cd-422b-af4f-7901976b0d84 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084610 May 12 20:56:47.213364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 616/1299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:48.231074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:48.231921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:48.238723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:48.239169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:48.240092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:48.240479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:48.302495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:48.309972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f8ac8d6e-0866-4f75-86ab-0ffae5f9e182 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082892 May 12 20:56:48.310533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 617/1300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:49.328895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:49.329587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:49.336082 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:49.336526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:49.337315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:49.337761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:49.407141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:49.414834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-baf6b651-ab5a-4c6a-81a3-ccf834c353fd tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.091520 May 12 20:56:49.415418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 618/1301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:49 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:50.432116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:50.432813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:50.440943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:50.441470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:50.442255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:50.442697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:50.506095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:50.514610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b4bcee4e-4eb3-4939-84ee-596bbc0cff30 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086375 May 12 20:56:50.515190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 619/1302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:51.531495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:51.532209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:51.538609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:51.539061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:51.539831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:51.540265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:51.602618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:51.610757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd3b87a4-e821-45a6-bebb-ae9242b94351 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083155 May 12 20:56:51.611319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 620/1303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:52.628596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:52.629360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:52.635846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:52.636379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:52.637077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:52.638185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:52.699757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:52.711679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5aaf8e36-9acf-4b2e-8272-344e4d6243dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086955 May 12 20:56:52.712259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 621/1304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:53.728830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:53.729676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:53.736208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:53.736661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:53.737482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:53.737918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:53.802248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:53.809903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9a008915-7eed-44d7-9462-2ad88e232f26 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085023 May 12 20:56:53.810797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 622/1305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:54.828287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:54.829261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:54.835394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:54.835839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:54.836600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:54.837032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:54.900412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:54.908443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-97829e36-e992-49a4-b304-b30c6d6a365b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085031 May 12 20:56:54.909016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 623/1306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:55.925306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:55.925993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:55.932200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:55.932649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:55.933434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:55.933868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:55.996738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:56.004655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-beb4909c-071c-4140-bd66-1584ee4be04c tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083208 May 12 20:56:56.005224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 624/1307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:56:57.022358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:57.023037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:57.029581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:57.030036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:57.030900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:57.031453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:57.097556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:57.105300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0485f429-bbe7-4e33-8a2c-26c77cc5c757 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086885 May 12 20:56:57.105888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 625/1308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:58.122284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:58.122972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:58.129720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:58.130174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:58.130928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:58.131358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:58.196989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:58.205406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-208a2d61-7d5d-436a-b0c7-a96d52752994 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086923 May 12 20:56:58.205975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 626/1309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:56:59.223068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:56:59.223723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:56:59.231919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:59.232370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:59.233142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:56:59.233604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:56:59.296339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:56:59.304439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c6f4bde3-6eee-4946-a309-4095cd0af71d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086124 May 12 20:56:59.304995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 627/1310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:56:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:00.320552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:00.321246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:00.327585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:00.328040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:00.328808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:00.329576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:00.391623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:00.399012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7f2054bc-7396-445c-8c56-24c5ec73e9ac tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082372 May 12 20:57:00.399561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 628/1311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:00 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:01.415913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:01.416621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:01.423268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:01.423752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:01.424527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:01.424966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:01.486511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:01.494132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-711fc6e2-6fec-425c-ae51-d4ba0a749be9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082076 May 12 20:57:01.494671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 629/1312] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:02.511998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:02.512829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:02.519720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:02.520170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:02.520944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:02.521412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:02.586412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:02.593874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0dd55d9d-21ad-4b83-a682-120bf1a6807b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086010 May 12 20:57:02.594448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 630/1313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:03.614386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:03.619303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:03.626773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:03.627398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:03.628166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:03.628608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:03.692216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:03.699735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6436f3bf-72dc-400f-b607-22b0741bf125 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.091953 May 12 20:57:03.700291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 631/1314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:04.716045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:04.716712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:04.723879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:04.724321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:04.725089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:04.725552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:04.793624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:04.804962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4207b25-e3d7-47bf-9699-f37e5e7977bb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.092657 May 12 20:57:04.805604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 632/1315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:05.823134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:05.823803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:05.830193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:05.830772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:05.831939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:05.832375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:05.897427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:05.905399 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9bb241f0-4db4-415a-8aab-8b430556319b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086166 May 12 20:57:05.905986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 633/1316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:06.923121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:06.923766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:06.930782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:06.931229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:06.932049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:06.932508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:06.999034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:07.007290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d3703d25-8336-4ed7-a2eb-231721dcbf82 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.088073 May 12 20:57:07.007854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 634/1317] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:08.024971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:08.025698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:08.032017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:08.032461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:08.033217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:08.034340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:08.094831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:08.103410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eecd766a-daf9-47a8-aee2-5f29ee10a569 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082437 May 12 20:57:08.104043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 635/1318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:09.120758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:09.121436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:09.127790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:09.128234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:09.129572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:09.130007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:09.193160 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:09.200588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a3e00fc7-49b0-46a1-ac78-5a7fe665b99a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083730 May 12 20:57:09.201157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 636/1319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:10.218610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:10.219285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:10.225664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:10.226110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:10.226878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:10.227309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:10.289128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:10.296584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-304d74aa-96b6-4371-93cd-729e62f41c7d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082014 May 12 20:57:10.297145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 637/1320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:11.318698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:11.320378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:11.327288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:11.327881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:11.328830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:11.329418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:11.401491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:11.409689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-edbd84e1-eff9-452d-8482-281f498d2882 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.098350 May 12 20:57:11.410267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 638/1321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:11 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:12.427922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:12.428565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:12.434815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:12.435259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:12.436008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:12.436546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:12.498163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:12.507046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-89762182-f63b-4aca-a562-a58dca034a80 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083718 May 12 20:57:12.507616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 639/1322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:13.525211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:13.526219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:13.531771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:13.532226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:13.533000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:13.533553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:13.598066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:13.606156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-03de3e3c-aff4-4ad7-814a-0b5fda5ad160 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085048 May 12 20:57:13.606726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 640/1323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:14.623741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:14.624356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:14.630737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:14.631187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:14.632228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:14.632680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:14.696636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:14.704351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5fbc02ff-bd6a-45b1-8c16-b2f87fe30ba4 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084564 May 12 20:57:14.704935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 641/1324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:15.722198 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:15.722909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:15.729744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:15.730192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:15.730960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:15.731402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:15.803756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:15.811480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8d34d721-44c5-4070-ab12-c66f21cd61dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.093290 May 12 20:57:15.812442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 642/1325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:16.828112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:16.828856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:16.836014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:16.836465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:16.837250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:16.837706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:16.902265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:16.909705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9b7512e2-39f1-46e1-9e32-397899e1a1fc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085485 May 12 20:57:16.910276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 643/1326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:17.926887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:17.927527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:17.934077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:17.934528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:17.935302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:17.935742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:17.998184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:18.005481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5619ceda-b62e-4ac6-9b82-db9bc345f0ea tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082516 May 12 20:57:18.006048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 644/1327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:19.024192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:19.024923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:19.031357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:19.031802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:19.032572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:19.033005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:19.097768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:19.105959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-86812a0d-449a-4962-825d-98ae59e0f521 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086743 May 12 20:57:19.106517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 645/1328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:20.122190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:20.122849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:20.129043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:20.129554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:20.130335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:20.130777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:20.199483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:20.207165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-618cf716-227e-438c-8f15-d1fd400443d2 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.089041 May 12 20:57:20.207744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 646/1329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:20 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:21.224959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:21.225653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:21.232192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:21.232642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:21.233454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:21.233891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:21.296172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:21.303834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dba56ad9-62bc-45a7-9fea-227086584a51 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082884 May 12 20:57:21.304415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 647/1330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:21 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:22.321334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:22.322551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:22.329560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:22.330014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:22.330782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:22.331214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:22.395206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:22.403026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c6f78c3-0143-4e33-95ca-41d90e12a186 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085680 May 12 20:57:22.403578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 648/1331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:22 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:23.419715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:23.420376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:23.426773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:23.427218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:23.427976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:23.428408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:23.491850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:23.500336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0afa8f76-a3f5-4d91-b4ed-579fa2deac16 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084669 May 12 20:57:23.500895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 649/1332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:23 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:24.517604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:24.518384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:24.524561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:24.525013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:24.525803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:24.526413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:24.591020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:24.598527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7231eedb-cd52-4419-adf8-e7b321d2f708 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084796 May 12 20:57:24.599097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 650/1333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:24 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:25.616047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:25.616764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:25.623920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:25.624400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:25.625425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:25.625980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:25.690852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:25.698597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9c03dc41-7ec0-4d43-8b7f-9bde0a1480ee tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086470 May 12 20:57:25.699161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 651/1334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:25 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:26.717833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:26.718666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:26.725178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:26.725665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:26.726441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:26.726880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:26.793515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:26.801180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d7e05836-c260-430b-8db9-67acaa51d128 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.088208 May 12 20:57:26.801782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 652/1335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:26 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:27.491063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 HTTP/1.1 May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:57:27.494341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 20:57:27.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'server_id': 'c5583a9e-213d-4250-afa6-8a77981ef335', 'id': 'b2c7843a-fd65-4f95-b0c0-20e9c77334c2'} May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:57:27.497864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 20:57:27.498978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.500156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.501511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) May 12 20:57:27.502858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.504140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-12394742-8772-48dd-b3cd-ccc8997c4bc9) {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:57:27.504140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eac68c0e-821b-457c-b64a-ec8b5a099e34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2" status: 400 len: 269 microversion: 2.1 time: 54.719651 May 12 20:57:27.504140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 684/1336] 10.222.0.59 () {58 vars in 1415 bytes} [Thu May 12 20:56:32 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments/b2c7843a-fd65-4f95-b0c0-20e9c77334c2 => generated 269 bytes in 54722 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 20:57:27.507750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:27.508689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:27.514992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.515450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.516227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.516666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.549649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-218de20e-2f6e-4b2a-8e61-20d498a54c89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045700 May 12 20:57:27.552525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 653/1337] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:27.584032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:27.589015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:27.590925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.591387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.592170 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.592610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.607190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: DELETE /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 HTTP/1.1 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 20:57:27.608838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.610474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '6f740839-8a3c-4567-8b6f-9256a71e0115'} May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:57:27.611377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.612703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 20:57:27.614078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:57:27.614078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f84aa406-dfda-44eb-b380-fc470c4d8835 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 404 len: 111 microversion: 2.1 time: 0.030468 May 12 20:57:27.614078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 685/1338] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 20:57:27 2022] DELETE /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:57:27.618874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:27.619445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 6f740839-8a3c-4567-8b6f-9256a71e0115] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:27.626135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.626595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.627375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.627818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.657010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 HTTP/1.1 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 20:57:27.658692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.660293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '6f740839-8a3c-4567-8b6f-9256a71e0115'} May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 20:57:27.661255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. May 12 20:57:27.662618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 20:57:27.664230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 6f740839-8a3c-4567-8b6f-9256a71e0115 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 20:57:27.664230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-672e0a5f-1898-466c-87d8-d91259504eca tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115" status: 404 len: 111 microversion: 2.1 time: 0.045190 May 12 20:57:27.664230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 654/1339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:27 2022] GET /compute/v2.1/servers/6f740839-8a3c-4567-8b6f-9256a71e0115 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 20:57:27.818006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:27.818725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:27.824853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.825331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.826223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:27.826659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:27.892709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:27.900521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1a36dc58-06e2-46d6-b9a7-d6138de5953d tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086508 May 12 20:57:27.908983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 686/1340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:27 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:28.561491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:28.562420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:28.568924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:28.569422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:28.570265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:28.570711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:28.601569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7ada6310-acce-40a1-8925-ae060e7d5715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044173 May 12 20:57:28.602151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 655/1341] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:28.919312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:28.920726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:28.927361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:28.927806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:28.928575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:28.929060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:28.991917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:29.000806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0fa49bda-aedf-4666-831b-8fbe3b08279a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085078 May 12 20:57:29.001398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 687/1342] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:28 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:29.613931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:29.614866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:29.621286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:29.621753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:29.622965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:29.623171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:29.655651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6bf6b9c9-0c28-42cf-80c9-a45d5212df24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045721 May 12 20:57:29.656139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 656/1343] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:30.019232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:30.019796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:30.026511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:30.026955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:30.027724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:30.028158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:30.093994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:30.101565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ae35b51a-cb46-446b-a5cd-11e13febd2c3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086465 May 12 20:57:30.102125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 688/1344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:30 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:30.667904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:30.668835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:30.676436 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:30.676991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:30.677931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:30.678669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:30.718729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5513ae57-9e35-49f1-a387-9d3b35b141c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054853 May 12 20:57:30.719321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 657/1345] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:31.120981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:31.121625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:31.130753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:31.131205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:31.131994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:31.132432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:31.197181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:31.205126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-866729eb-3b67-4bfa-9756-fc57388a75c5 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.090211 May 12 20:57:31.205740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 689/1346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:31 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:31.731228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:31.732793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:31.739444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:31.739892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:31.740673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:31.741109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:31.774144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d6dd0588-9b44-4b17-93fd-844beae10f1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046714 May 12 20:57:31.774742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 658/1347] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:32.225911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:32.226729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:32.233191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:32.233677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:32.234616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:32.234998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:32.301678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:32.309327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dd88195e-2b57-49ee-9b05-516f9d9a1063 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.088653 May 12 20:57:32.309911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 690/1348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:32 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:32.786330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:32.787249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:32.793611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:32.794068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:32.794833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:32.795271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:32.827439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dbf667b7-38b3-4a77-8361-9b722a395f93 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044702 May 12 20:57:32.828034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 659/1349] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:57:33.327950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:33.328625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:33.334936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:33.335386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:33.336154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:33.336588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:33.400551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:33.409247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3b054c90-ddcb-4d72-b89b-948fed7f254a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085788 May 12 20:57:33.409840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 691/1350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:33 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:57:33.839257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:33.840184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:33.846900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:33.847350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:33.849174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:33.849174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:33.879458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-51ba48b8-1f8b-4f1a-8c62-2c9fb9847f4f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044110 May 12 20:57:33.880032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 660/1351] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:34.426009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:34.426691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:34.432934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:34.433420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:34.434195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:34.434634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:34.500694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:34.508356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5dbc77d3-3a43-4838-942a-782f8d04cd2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086217 May 12 20:57:34.508987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 692/1352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:34 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:34.891672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:34.892638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:34.899158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:34.899615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:34.900393 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:34.900829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:34.932526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3a219193-a3ea-4921-be19-9fde771e899a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044903 May 12 20:57:34.933088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 661/1353] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:35.526461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:35.527087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:35.534304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:35.534760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:35.535533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:35.535977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:35.599895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:35.607323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8760347e-47ab-4977-84d7-2eb75054075a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084720 May 12 20:57:35.607874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 693/1354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:35 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:35.945444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:35.946380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:35.952679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:35.953777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:35.954627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:35.955073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:35.985135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ba85fbaf-04f8-4637-8044-11ae7589ad4b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043632 May 12 20:57:35.985750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 662/1355] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:36.624146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:36.625446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:36.631970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:36.632420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:36.633217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:36.633695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:36.703417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:36.710775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-89fa6c71-dbc3-48cf-a36c-2891c8dc1215 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.090511 May 12 20:57:36.711347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 694/1356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:36 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:36.996362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:36.997206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:37.004357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:37.004810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:37.005652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:37.006091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:37.037969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0dda7f35-a845-446b-bad7-09442588ce15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045624 May 12 20:57:37.038530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 663/1357] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:37.728222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:37.728871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:37.735777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:37.736226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:37.737007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:37.737470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:37.803852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:37.814897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9417b218-682e-4968-9f52-65ec2bd24e57 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.090450 May 12 20:57:37.815563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 695/1358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:37 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:38.050326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:38.051182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:38.058057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:38.058509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:38.059290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:38.059935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:38.094829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-24400cdb-733b-436e-bd14-21a2df264497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047655 May 12 20:57:38.095781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 664/1359] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:57:38.832861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:38.833506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:38.839963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:38.840407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:38.841168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:38.841625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:38.907273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:38.914926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e7621c13-f292-4785-8d25-3e601be0e7a3 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086440 May 12 20:57:38.915497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 696/1360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:38 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:39.107132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:39.107973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:39.114554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:39.115007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:39.115769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:39.116206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:39.146887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c55862f2-bb80-4cd6-b8cc-8bdb0b08d6dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043752 May 12 20:57:39.147458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 665/1361] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:39.934218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:39.934826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:39.940969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:39.941492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:39.942281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:39.942719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:40.160065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:40.160850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:40.167829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:40.168293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:40.169086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:40.169570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:40.202271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15ef9ca3-8db8-4739-a9dc-f9ce6ec1a8a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047241 May 12 20:57:40.203921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 666/1362] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:57:40.277227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:40.285568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-546f6911-1a0b-462b-9323-f14d71a9a00e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.355751 May 12 20:57:40.286140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 697/1363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:39 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:41.215717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:41.216573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:41.223112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:41.223565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:41.224324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:41.224762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:41.253959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5be9c772-3440-4c96-85d7-6935bb932956 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042372 May 12 20:57:41.254518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 667/1364] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:41.303296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:41.303894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:41.310189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:41.310639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:41.311398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:41.311834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:41.377056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:41.384854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-67e54808-6701-4ced-82ab-1f9e72a1fb3e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085845 May 12 20:57:41.385454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 698/1365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:41 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:42.265910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:42.266739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:42.273791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:42.274238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:42.274988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:42.275419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:42.304307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-723b04a5-c1dc-41e1-ab32-7b3fb5b14eb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042388 May 12 20:57:42.304845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 668/1366] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:42.402043 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:42.403734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:42.409306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:42.409766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:42.410535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:42.410971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:42.472011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:42.479435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d0e36a96-762a-4a43-9fa7-f1b7ea13ff10 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081357 May 12 20:57:42.479999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 699/1367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:42 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:43.317452 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:43.318279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:43.324127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:43.324571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:43.325361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:43.325795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:43.354820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-20337279-b1dd-4aed-85d9-86c52dab0137 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042629 May 12 20:57:43.355366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 669/1368] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:43.496039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:43.496655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:43.503294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:43.503752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:43.504523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:43.504962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:43.565697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:43.573468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-73b80130-debf-4ba8-b383-7a3988984fff tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081244 May 12 20:57:43.573961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 700/1369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:43 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:44.366727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:44.367645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:44.373987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:44.374380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:44.375127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:44.375556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:44.405868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-083c2acf-7526-4ebd-b09b-afdd064917fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043101 May 12 20:57:44.406417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 670/1370] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:44.591439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:44.592046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:44.598547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:44.598993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:44.599749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:44.600176 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:44.663308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:44.670653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28eaf520-f114-404e-9f87-8617952658f7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083104 May 12 20:57:44.671209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 701/1371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:44 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:45.418115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:45.419034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:45.425744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:45.426192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:45.426952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:45.427388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:45.457088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-64645eeb-b276-4f8a-b881-84a1850e9921 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042946 May 12 20:57:45.457665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 671/1372] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:45.687998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:45.688564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:45.695572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:45.696023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:45.696788 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:45.697225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:45.757550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:45.765367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ed8518b5-ca6e-485c-81bb-a44bfb594dfb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081368 May 12 20:57:45.765944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 702/1373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:45 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:46.468196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:46.469110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:46.475581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:46.476030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:46.476781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:46.477210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:46.505842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-89ff48ae-1c43-46d6-aca4-d9dc6d5ebc05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041615 May 12 20:57:46.506388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 672/1374] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:46.783039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:46.783675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:46.790064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:46.790514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:46.791280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:46.791714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:46.852647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:46.860125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e8d0d3d-ffd0-40ef-a922-a087a79f29c1 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081115 May 12 20:57:46.860729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 703/1375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:46 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:47.518629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:47.519549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:47.525937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:47.526393 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:47.527194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:47.527634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:47.556772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-688e011f-f235-450f-a26e-4529dd37d85b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042615 May 12 20:57:47.557344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 673/1376] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:47.878254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:47.878862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:47.885503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:47.885951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:47.886713 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:47.887222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:47.951351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:47.959699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b29b02f8-c757-4e6b-a861-2e3611c3ce02 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.085839 May 12 20:57:47.960270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 704/1377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:47 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:48.569022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:48.569966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:48.576269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:48.576717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:48.577513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:48.577944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:48.607293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-acd068d7-cee9-4505-90ad-95ec58248038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043147 May 12 20:57:48.607845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 674/1378] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:57:48.977025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:48.977694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:48.983553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:48.984000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:48.984799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:48.985232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:49.047686 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:49.056081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-915dc811-201d-4aba-8a25-d95ac38599bc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083484 May 12 20:57:49.056620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 705/1379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:48 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:49.618939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:49.619864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:49.626078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:49.626560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:49.627391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:49.628042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:49.659063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0450cdb8-dff2-4149-8903-76e69b70ad77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043563 May 12 20:57:49.659625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 675/1380] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:50.073446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:50.074011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:50.079978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:50.080610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:50.081386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:50.081821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:50.143156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:50.150614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e503c2f-ab30-42d1-84ec-dd6ba32177d7 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081101 May 12 20:57:50.151180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 706/1381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:50 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:50.670859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:50.671774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:50.678680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:50.679126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:50.679881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:50.680312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:50.710403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df026277-a06f-4b6d-82cc-128fcf879c9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043573 May 12 20:57:50.710953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 676/1382] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:51.167975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:51.168590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:51.175067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:51.175517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:51.176281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:51.176718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:51.237038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:51.244305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1ea4bbaf-5faa-48b5-b223-ca1ac42828df tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.080316 May 12 20:57:51.244865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 707/1383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:51 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:51.721872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:51.722788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:51.729102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:51.729580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:51.730361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:51.730792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:51.760284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df66569f-47bc-4b33-9653-f823e09a5d58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042242 May 12 20:57:51.760832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 677/1384] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:52.261112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:52.261750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:52.268195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:52.268636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:52.269421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:52.269853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:52.329750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:52.337219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-848634cc-e0cc-4b96-987d-4a7de3cd5d2e tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.080082 May 12 20:57:52.337813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 708/1385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:52 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:52.772141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:52.773071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:52.779392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:52.779845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:52.780610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:52.781047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:52.809825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e4b7e6eb-2275-4c0c-86f6-fcc80452e6ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041720 May 12 20:57:52.810375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 678/1386] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:53.355025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:53.355616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:53.362656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:53.363095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:53.363851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:53.364277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:53.426690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:53.433953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-21215a5a-f887-4f13-adea-3f922610f559 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082815 May 12 20:57:53.434789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 709/1387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:53 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:53.821949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:53.822783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:53.829014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:53.829497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:53.830865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:53.831419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:53.860360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c855766d-7a6f-43e4-8d42-cdb20e91ff7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042461 May 12 20:57:53.860918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 679/1388] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:54.450626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:54.451223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:54.458763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:54.459209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:54.459965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:54.460394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:54.521012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:54.529682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c25c1e81-c760-49ba-bf12-e0d8be5a3840 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082835 May 12 20:57:54.530245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 710/1389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:54 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:54.872274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:54.873191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:54.880221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:54.881045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:54.881564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:54.882029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:54.912188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-96c95f50-ee90-40ae-b6c9-d5991950cbe6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043942 May 12 20:57:54.912742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 680/1390] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:55.547119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:55.547804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:55.554784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:55.555231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:55.555994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:55.556428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:55.621003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:55.629358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a38f79a2-7144-4a23-90aa-ed957da2fdbb tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.086022 May 12 20:57:55.629929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 711/1391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:55 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:55.925041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:55.926018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:55.932275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:55.932700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:55.933494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:55.933924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:55.964524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1fbbb18b-3a74-454d-b24d-bb01573e9a59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044171 May 12 20:57:55.965090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 681/1392] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:56.647263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:56.647938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:56.654401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:56.654846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:56.655619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:56.656058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:56.718217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:56.726417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ce472f0e-58ef-44f8-9624-48debbf35154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083971 May 12 20:57:56.726985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 712/1393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:56 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:56.976367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:56.977182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:56.983611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:56.984062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:56.984822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:56.985259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:57.014423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3f184391-88ec-4500-8bc1-118afee77f27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042151 May 12 20:57:57.014979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 682/1394] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:57.743267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:57.743884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:57.750270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:57.750771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:57.752104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:57.752714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:57.819822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:57.827641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ef640809-43c4-4e4a-b229-5380ab027ad6 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.088238 May 12 20:57:57.828233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 713/1395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:57 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:58.027185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:58.028010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:58.034435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:58.034912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:58.035666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:58.036097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:58.065894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-405096d4-6436-4400-8eca-43b62229f4a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042720 May 12 20:57:58.066449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 683/1396] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:58.845215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:58.846095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:58.852360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:58.852804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:58.853599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:58.854030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:58.915359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:57:58.922871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-09c25b40-63c0-4002-ae43-dbba7a46c234 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081486 May 12 20:57:58.924118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 714/1397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:58 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:57:59.077321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:59.078288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:59.084581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:59.085032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:59.085830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:59.086270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:59.116535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-71d9593c-1481-4117-9f3c-526258a639a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043115 May 12 20:57:59.117021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 684/1398] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:57:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:57:59.940575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:57:59.941165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:57:59.947960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:59.948410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:57:59.949178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:57:59.949640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:00.020642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:00.028310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f2db8493-ec18-4c67-b026-18fa5d49bd9a tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.092377 May 12 20:58:00.028882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 715/1399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:57:59 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:00.128238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:00.129074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:00.135824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:00.136276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:00.137043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:00.137516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:00.167047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fe186741-ae50-408b-83cf-465d71f22a1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043417 May 12 20:58:00.167612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 685/1400] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:01.045148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:01.045794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:01.052214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:01.052663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:01.053446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:01.053886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:01.114070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:01.121507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c6215e66-d624-4909-8edb-c1649dc98717 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.080147 May 12 20:58:01.122077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 716/1401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:01 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:01.179052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:01.179973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:01.186450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:01.186931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:01.187728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:01.188165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:01.217565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dc0204b7-f74b-4658-aa39-8f9c043d70ed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042439 May 12 20:58:01.218110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 686/1402] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:02.139050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:02.139614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:02.146315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:02.146758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:02.147524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:02.147953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:02.214350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:02.222497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e762440b-b997-401a-9e0b-76baa4fe1977 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.087605 May 12 20:58:02.223057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 717/1403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:02 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:02.230391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:02.231401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:02.238467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:02.238919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:02.239695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:02.240130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:02.269351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f88813bd-c8ae-4c15-905b-f19ebf97ec50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042816 May 12 20:58:02.269938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 687/1404] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:03.239497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:03.240048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:03.246412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:03.246870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:03.247631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:03.248064 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:03.281445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:03.282563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:03.289499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:03.289952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:03.290765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:03.291206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:03.308275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:03.316969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-15d0c2e7-655e-435b-9feb-163267352c2b tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081915 May 12 20:58:03.317572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 718/1405] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:03 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:03.322917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a8c772aa-9c83-4d39-b4ed-80b44b340dd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045340 May 12 20:58:03.323483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 688/1406] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:58:04.334812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:04.335373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:04.335761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:04.335869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:04.341717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:04.342139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:04.342271 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:04.342599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:04.342976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:04.343363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:04.343465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:04.343804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:04.373244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5131e36a-2ab0-4860-bcbf-24ec8e89fb3e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042230 May 12 20:58:04.373837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 689/1407] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:58:04.404759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:04.412300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-344e247b-3350-4864-b205-87f29e101424 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081566 May 12 20:58:04.413011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 719/1408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:04 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:05.386190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:05.387115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:05.393499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:05.393955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:05.394713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:05.395151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:05.424719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5d8b629a-731e-411a-be44-bcfffce6681e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042764 May 12 20:58:05.425358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 690/1409] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:05.430346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:05.430970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:05.437174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:05.437647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:05.438401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:05.438865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:05.500206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:05.508095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0c9360b8-5cc2-4179-a544-818e4ca43fc0 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081525 May 12 20:58:05.508664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 720/1410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:05 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:58:06.436381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:06.437363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:06.444306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:06.444759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:06.445555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:06.445997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:06.474558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-282ce8b3-96e7-4522-8b6c-fc09e3b00ede tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042173 May 12 20:58:06.475089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 691/1411] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:06.525724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:06.526343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:06.532704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:06.533152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:06.533942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:06.534380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:06.598003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:06.605657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b69acd6f-0cab-4219-8943-17f7602380e9 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.083766 May 12 20:58:06.606228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 721/1412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:06 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:07.394325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:58:07.394572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:58:07.486104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:07.487024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:07.493433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:07.493887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:07.494695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:07.495154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:07.525190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dc196135-d386-4c6f-937a-f325c1fedcbd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043157 May 12 20:58:07.525786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 692/1413] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:07.623113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:07.623721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:07.630783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:07.631228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:07.631982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:07.632414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:07.700067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:07.708072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a30e8c59-8fc0-41a2-afa3-45a1087a8745 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.088825 May 12 20:58:07.708642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 722/1414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:07 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:08.538255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:08.539203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:08.545487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:08.545974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:08.546724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:08.547153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:08.576593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-50c0ac2f-05c4-46b2-bd3c-5762cf593ec7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042452 May 12 20:58:08.577145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 693/1415] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:08.725733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:08.726341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:08.732737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:08.733187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:08.733994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:08.734423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:08.794981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:08.802313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-77d39f30-ea93-414f-a018-43259cca14dc tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.080486 May 12 20:58:08.802876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 723/1416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:08 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:09.589756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:09.590707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:09.597638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:09.598090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:09.598848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:09.599285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:09.629458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bbceae37-f569-44f6-8d9e-e03fd70fd771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043691 May 12 20:58:09.635946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 694/1417] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:09.820334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:09.820947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:09.827363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:09.827811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:09.828575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:09.829015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:09.893001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:09.900638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ecf72670-fc1d-4565-b467-e5d6d447b154 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084250 May 12 20:58:09.901219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 724/1418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:09 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:10.644348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:10.645265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:10.651623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:10.652071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:10.652828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:10.653260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:10.682622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d6cf8403-89cc-4191-8e85-539b4a2d1658 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042296 May 12 20:58:10.683169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 695/1419] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:10.918742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:10.919277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:10.926202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:10.926644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:10.927407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:10.927837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:10.990216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:10.997591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5d4d9972-4fa1-486c-925b-95d98d795e01 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082790 May 12 20:58:10.998155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 725/1420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:10 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 20:58:11.695090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:11.696299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:11.707383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:11.708243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:11.709254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:11.710004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:11.741159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b6c419b0-9c4d-450f-a10d-8cb81e4b8a9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050029 May 12 20:58:11.741763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 696/1421] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:12.015797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:12.016339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:12.023084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:12.023530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:12.024288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:12.024718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:12.086054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:12.093225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-de2a2ced-b32c-4796-8c4e-c435b1ca4423 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.081327 May 12 20:58:12.093807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 726/1422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:12 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:12.753809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:12.754670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:12.761352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:12.761835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:12.762584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:12.763029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:12.793637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-38655eb4-1a6a-4ccf-aff2-d5c7179d0728 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044710 May 12 20:58:12.794203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 697/1423] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:13.110520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:13.111155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:13.117980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:13.118429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:13.119257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:13.119690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:13.183078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:13.198596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-574ea6fa-d43e-40e7-a243-2ce98d733a19 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.091964 May 12 20:58:13.199169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 727/1424] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:13 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:13.805738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:13.806754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:13.812590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:13.813029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:13.814220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:13.814687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:13.847258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9c42e487-b988-482d-afff-7a9ab07d0f88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045571 May 12 20:58:13.847856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 698/1425] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:14.216413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:14.217119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:14.224655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:14.225234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:14.226052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:14.226491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:14.289150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:14.296559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b632c8a2-fc99-4627-8539-75eedd92055f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084632 May 12 20:58:14.297125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 728/1426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:14 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:14.859303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:14.860313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:14.866858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:14.867304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:14.868067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:14.868505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:14.901414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfaa01af-08ac-4f43-b4df-98da39659f28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045843 May 12 20:58:14.901901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 699/1427] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:15.314782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:15.315345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:15.321685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:15.322127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:15.322891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:15.323315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:15.386683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:15.394537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-612082e0-dd57-47f8-be5b-29836d200e2f tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084395 May 12 20:58:15.395107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 729/1428] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:15 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:15.913309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:15.914919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:15.920993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:15.921480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:15.922251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:15.922689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:15.954733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b929d8ff-139a-4908-9d97-c6fe63e33e41 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044548 May 12 20:58:15.955316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 700/1429] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:16.411721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:16.412332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:16.418784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:16.423628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:16.423628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:16.423628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:16.484429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:16.491982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-aa9db750-4b69-4128-9aba-00b51fa23dce tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.084241 May 12 20:58:16.492546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 730/1430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:16 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:16.966321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:16.967255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:16.974129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:16.974576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:16.975337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:16.975769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:17.006456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-33bd5e93-5f1d-44b8-84db-d663ca8a7aa4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044099 May 12 20:58:17.007019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 701/1431] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:17.509440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:17.510300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:17.516846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:17.517309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:17.518080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:17.518516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:17.578933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:17.586429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b05dcfa3-62c8-4a46-bcd1-4ae118641550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.080996 May 12 20:58:17.586983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 731/1432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:17 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:18.018134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:18.019091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:18.025644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:18.026098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:18.026907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:18.027370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:18.057800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-112e0149-6134-484f-9ad2-bded5f439e37 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043710 May 12 20:58:18.058368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 702/1433] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:18.603517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:18.604177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:18.611105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:18.611560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:18.612354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:18.612810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:18.674787 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:18.682231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-231e87ed-a9a8-4221-810b-13bb62b37550 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.082709 May 12 20:58:18.682794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 732/1434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:18 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:19.069127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:19.070174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:19.076595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:19.077047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:19.077837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:19.078273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:19.109069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c055630a-32c0-4dc8-8959-1158f332db86 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043946 May 12 20:58:19.109642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 703/1435] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:19.699423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:19.700036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] [instance: a2d38838-7cd2-4f6f-a3a8-36148bd113ad] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:19.707344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:19.707806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:19.708574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:19.709013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:19.779090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565a25c59df84a1fa6f6420093e89fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9b727e705940c5bbdad32f9cb69087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 20:58:19.787356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-74c0acf2-6eb8-44de-b31a-8b64df958c89 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad" status: 200 len: 1214 microversion: 2.1 time: 0.091817 May 12 20:58:19.787933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 733/1436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 20:58:19 2022] GET /compute/v2.1/servers/a2d38838-7cd2-4f6f-a3a8-36148bd113ad => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 20:58:20.033011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-95ad24d3-0ec9-4b46-b16d-8949ee6f5198 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] Calling method '.version_select at 0x7f4e62c7c160>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:20.095716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-95ad24d3-0ec9-4b46-b16d-8949ee6f5198 tempest-TestShelveInstance-1465366949 tempest-TestShelveInstance-1465366949-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1269171328" status: 202 len: 0 microversion: 2.1 time: 0.067942 May 12 20:58:20.101810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 704/1437] 10.222.0.59 () {58 vars in 1253 bytes} [Thu May 12 20:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1269171328 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 20:58:20.120890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:20.127297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:20.134126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:20.135067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:20.136055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:20.136769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:20.170003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f28cff17-6257-46b7-8f52-d53a6f0d5ff8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053201 May 12 20:58:20.170525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 734/1438] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:21.182076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:21.182983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:21.190327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:21.190833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:21.191607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:21.192042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:21.228394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-40d33a79-da04-4bb2-a63e-2b571af4ef8b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050652 May 12 20:58:21.228873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 705/1439] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:22.241002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:22.242042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:22.248492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:22.248958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:22.249772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:22.250211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:22.283190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-35c20a0f-5e15-4744-b1d3-285ec98d65ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046225 May 12 20:58:22.284080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 735/1440] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:23.295107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:23.296176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:23.303499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:23.303979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:23.304761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:23.305201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:23.335613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfc125e0-95bb-4170-83e2-0da89ca0299e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044897 May 12 20:58:23.336528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 706/1441] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:24.347645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:24.348580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:24.354920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:24.355363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:24.356118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:24.356548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:24.387243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-28c37fe0-eb39-4b86-ba73-fec41a7288b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043754 May 12 20:58:24.387807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 736/1442] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:25.399482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:25.400407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:25.406944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:25.407502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:25.408269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:25.408708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:25.439495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-55cd0300-e4d5-4f52-aec7-5af4550df18a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044060 May 12 20:58:25.444672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 707/1443] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:26.451542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:26.453014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:26.460156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:26.460600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:26.461683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:26.462320 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:26.494346 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-561ed855-d98a-43e7-804b-73c3c6b3303e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046653 May 12 20:58:26.498294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 737/1444] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:27.506128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:27.507051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:27.517866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:27.518579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:27.519533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:27.520137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:27.554773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c5cf03a9-ee36-4a5b-95f4-e10a0fe5fc5d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052526 May 12 20:58:27.559103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 708/1445] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:28.567434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:28.567995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:28.574833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:28.575314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:28.576232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:28.576665 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:28.613256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-513bffaa-eda4-4347-90cb-313b41d1a12f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050720 May 12 20:58:28.613855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 738/1446] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:29.624952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:29.626018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:29.632651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:29.633104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:29.633924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:29.634362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:29.667404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-efecd2f2-7172-4920-bd8b-537700e62643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046431 May 12 20:58:29.667882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 709/1447] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:30.679221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:30.680133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:30.686594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:30.687047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:30.687843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:30.688317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:30.714928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:58:30.715145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments (ip 10.222.0.59) !!! May 12 20:58:30.718089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-219390ad-41db-429c-a0fb-66a22d6b4028 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042874 May 12 20:58:30.720059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 739/1448] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:31.730480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:31.731676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:31.740060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:31.740758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:31.741787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:31.742538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:31.782162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-80f5b5c6-7989-45e0-9379-81c52d00e11b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055817 May 12 20:58:31.782747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 710/1449] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:32.793961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:32.794911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:32.801338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:32.802127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:32.802557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:32.802992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:32.834231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5a64dc94-7486-4b6c-a2b8-fbd24eb402bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044162 May 12 20:58:32.834791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 740/1450] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:33.846456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:33.847405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:33.853832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:33.854280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:33.855326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:33.856173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:33.890212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e9e6282a-f20d-42ca-9f86-a0f8ef12f014 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048202 May 12 20:58:33.890780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 711/1451] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:34.901963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:34.902890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:34.909245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:34.909742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:34.910488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:34.910924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:34.941864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-45d900a7-ef54-4175-8a6a-93051a8f3280 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043838 May 12 20:58:34.942415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 741/1452] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:35.953101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:35.954071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:35.961253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:35.961745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:35.962490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:35.962929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:35.993496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ca94e70b-e9d5-49f9-84ca-89c1344cebfe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044445 May 12 20:58:35.994057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 712/1453] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:37.005077 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:37.006005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:37.012508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:37.012953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:37.013733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:37.014172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:37.044305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a5924b6-9def-4e71-a7cd-61cf56075001 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043391 May 12 20:58:37.044852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 742/1454] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:38.056273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:38.057182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:38.063864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:38.064463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:38.065228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:38.065685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:38.094247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53df650c-a75b-4712-8ef9-8ac85a7d2a2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041916 May 12 20:58:38.095430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 713/1455] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:39.106992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:39.107908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:39.114734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:39.115174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:39.115926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:39.116352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:39.147134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-594750c0-9c69-4762-ae8b-42d0a4c89623 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044142 May 12 20:58:39.147694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 743/1456] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:40.159423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:40.160346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:40.166670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:40.167122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:40.167881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:40.168327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:40.197293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2fdc4030-2fe3-40d8-bf55-f1df5a02f626 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042475 May 12 20:58:40.197851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 714/1457] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:41.209007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:41.209939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:41.216363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:41.216837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:41.217624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:41.218056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:41.247445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-312b07fd-4df5-4fde-b43c-f4e584852593 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042422 May 12 20:58:41.247990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 744/1458] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:58:42.258912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:42.260081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:42.266387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:42.266837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:42.267623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:42.268051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:42.298123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e871ba2c-d203-4992-8771-ffe8b016f09e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042488 May 12 20:58:42.298793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 715/1459] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:43.309555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:43.310484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:43.317517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:43.317976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:43.318741 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:43.319180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:43.348060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-546d193a-224c-43d6-b490-60eceaabf8f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042513 May 12 20:58:43.348625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 745/1460] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:44.360333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:44.361250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:44.368316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:44.368761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:44.369566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:44.369996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:44.399388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c65cf92c-94cd-42d6-b159-10d7e0571b80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043026 May 12 20:58:44.399950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 716/1461] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:45.411500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:45.412429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:45.418750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:45.419207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:45.419978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:45.420420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:45.450400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-48aa216a-a0ce-4a9a-8a7d-b6f6c51b2cff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042922 May 12 20:58:45.450954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 746/1462] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:46.461920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:46.462846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:46.469110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:46.469797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:46.470561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:46.470996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:46.500011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c1663bf-8274-4f98-820a-e80476d541a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042039 May 12 20:58:46.501091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 717/1463] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:47.512466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:47.513318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:47.520484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:47.520935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:47.521734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:47.522165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:47.551356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-80c4189d-2184-4c3d-a7d8-75f210480dd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043167 May 12 20:58:47.551920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 747/1464] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:48.563978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:48.564851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:48.571348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:48.571807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:48.572567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:48.573007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:48.602778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-51f0554e-f4f3-4264-93e8-851a01177407 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043502 May 12 20:58:48.603330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 718/1465] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:49.614615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:49.615574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:49.621884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:49.622347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:49.623094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:49.623526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:49.654507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14b63174-424f-480c-8ad9-b352ddf7f222 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043897 May 12 20:58:49.655097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 748/1466] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:50.665762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:50.666680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:50.673130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:50.673630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:50.674387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:50.674820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:50.704342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-68624728-b001-4c1b-9c3d-91db5f90d29c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041953 May 12 20:58:50.704906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 719/1467] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:51.715707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:51.716628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:51.722802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:51.723250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:51.724015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:51.724522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:51.753191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3036a348-a165-435e-94fb-b16421be1e2e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041452 May 12 20:58:51.753771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 749/1468] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:52.764274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:52.765190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:52.772471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:52.772923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:52.773751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:52.774186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:52.803501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bae5ff25-e9c4-46b8-9b4c-f7e78ba1a0d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043436 May 12 20:58:52.804046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 720/1469] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:53.816104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:53.817023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:53.823321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:53.823769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:53.824528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:53.824965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:53.853961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc9b4fc2-616f-4904-88af-fb228975959e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042553 May 12 20:58:53.854515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 750/1470] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:54.866271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:54.867197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:54.873579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:54.874038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:54.874799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:54.875524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:54.905002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3c5b49f2-d321-4e08-acf6-4ed48001aa88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042826 May 12 20:58:54.905590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 721/1471] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:55.917226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:55.918181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:55.925219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:55.925711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:55.926484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:55.926923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:55.956730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-410071c2-ef23-446a-be55-d8942c0bab05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043461 May 12 20:58:55.957317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 751/1472] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:56.968969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:56.969900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:56.976206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:56.976656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:56.977454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:56.977895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:57.007252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-969e93e3-5f15-4f0c-939e-14997966cab7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042317 May 12 20:58:57.007803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 722/1473] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:58.019571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:58.020481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:58.026802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:58.027246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:58.028029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:58.028465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:58.058685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f958d14d-a5e4-42f6-bd14-84cb70ba12fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043463 May 12 20:58:58.059232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 752/1474] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:58:59.071597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:58:59.072480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:58:59.079525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:59.079978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:59.080745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:58:59.081185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:58:59.110625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-02e8702b-3e88-4ce3-86b6-f80fba2d043b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043099 May 12 20:58:59.111194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 723/1475] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:58:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:00.122239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:00.123157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:00.129667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:00.130111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:00.130868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:00.131296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:00.166548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bb1f0f42-46b1-4b13-bb2c-dc88917428fd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047343 May 12 20:59:00.166548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 753/1476] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:01.179219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:01.180045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:01.186354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:01.186847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:01.188378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:01.188829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:01.218050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f725e58d-b514-40c9-9d81-41feda26b6c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042882 May 12 20:59:01.218976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 724/1477] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:59:02.230156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:02.230989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:02.237484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:02.237932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:02.238691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:02.239125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:02.269193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46c519c6-6ff1-4e9f-9b6d-86ea0b413771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043071 May 12 20:59:02.269794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 754/1478] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:03.281937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:03.282787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:03.289059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:03.289537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:03.290307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:03.290746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:03.319449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3cca656d-3e25-4b17-8389-28a82fe89c8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042449 May 12 20:59:03.320000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 725/1479] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:04.331677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:04.332557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:04.338882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:04.339328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:04.340085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:04.340516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:04.370608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-01942456-9877-4fe7-a620-c5a4b02c111e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043151 May 12 20:59:04.371157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 755/1480] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:05.382584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:05.383414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:05.389969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:05.391165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:05.391951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:05.392400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:05.420879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4b549be7-d378-4649-8095-405ca2993567 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042574 May 12 20:59:05.421968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 726/1481] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:06.433618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:06.434456 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:06.440876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:06.441353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:06.442143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:06.442573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:06.472079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f3373e35-347b-457a-9549-c4e7db15e1eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042542 May 12 20:59:06.476555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 756/1482] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:07.484751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:07.485694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:07.492055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:07.492506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:07.493263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:07.493725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:07.523265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1281ab32-a4e5-4236-b34e-1cd9cfcf9071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043051 May 12 20:59:07.523859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 727/1483] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:08.535729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:08.536558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:08.543229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:08.543670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:08.544427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:08.544862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:08.576088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-48a0cc90-356d-43ce-a06c-441337d0a6f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044660 May 12 20:59:08.576641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 757/1484] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:09.588401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:09.589340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:09.595869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:09.596317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:09.597085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:09.597617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:09.628333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b84b16ca-1966-49b5-b1c3-e647a29cb6a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043893 May 12 20:59:09.628982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 728/1485] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:10.647282 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:10.648080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:10.654699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:10.655152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:10.656643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:10.657313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:10.687355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7fb91485-c466-48c4-a1e4-91e54832101e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043956 May 12 20:59:10.688049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 758/1486] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:11.699277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:11.700136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:11.707066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:11.707515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:11.708272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:11.708705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:11.738235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c8ad5b9c-f16c-4cc1-9b46-ca9bbf43770f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043028 May 12 20:59:11.738791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 729/1487] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:12.750182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:12.751019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:12.757348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:12.757800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:12.758560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:12.758995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:12.788244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fe1a4456-08a6-4637-9146-631b05728df4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042244 May 12 20:59:12.788796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 759/1488] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:13.801189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:13.802055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:13.807987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:13.808430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:13.809180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:13.809634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:13.840401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-78d1b2d8-3754-4044-80d8-ba5b524bfd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043835 May 12 20:59:13.841451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 730/1489] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:14.852601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:14.853554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:14.859884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:14.860339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:14.861108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:14.861790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:14.905163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9355d229-7f64-4f16-bed4-3e135238b405 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056483 May 12 20:59:14.905765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 760/1490] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:15.917351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:15.918411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:15.926695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:15.927229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:15.928039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:15.928476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:15.958637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-823c8fda-8c30-4897-8df3-766e94221b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045307 May 12 20:59:15.959197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 731/1491] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:16.970571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:16.972091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:16.978315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:16.978772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:16.979533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:16.979969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:17.010070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a364d1c-9bb1-4d6f-b05e-370ee837d901 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043247 May 12 20:59:17.010630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 761/1492] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:18.022700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:18.023537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:18.029961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:18.030414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:18.031179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:18.031614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:18.072508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60624972-ecb5-4935-ab9d-30255169830e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054636 May 12 20:59:18.073109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 732/1493] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:19.085395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:19.086324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:19.092633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:19.093088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:19.093879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:19.094319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:19.123351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bbd05cbf-2293-4cc2-b036-3822dac32500 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042088 May 12 20:59:19.123899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 762/1494] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:20.136155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:20.137092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:20.143776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:20.144231 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:20.145394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:20.145835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:20.181587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ed3e6699-1c12-4f1a-97a0-c90be964037f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049906 May 12 20:59:20.182165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 733/1495] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:21.194352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:21.195290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:21.201413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:21.201877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:21.202693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:21.203135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:21.234004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11e4355a-db2e-4955-9d25-a68d58831cb1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044397 May 12 20:59:21.234583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 763/1496] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:22.246511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:22.247345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:22.253904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:22.254360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:22.255117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:22.255549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:22.284750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9cc53822-0639-49af-99dd-06b0ab6ba73d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042269 May 12 20:59:22.285313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 734/1497] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:23.296574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:23.297443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:23.304185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:23.304633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:23.305415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:23.305850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:23.336696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-010c8ae3-c99a-44c4-8444-55da28003865 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044135 May 12 20:59:23.337249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 764/1498] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:24.349726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:24.350685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:24.357047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:24.357538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:24.358298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:24.358733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:24.396907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3761f0fe-00f2-4cfa-955a-6253bbc43743 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051965 May 12 20:59:24.398010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 735/1499] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:25.409820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:25.410662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:25.416902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:25.417378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:25.418130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:25.418557 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:25.448567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6f9a94b0-d2a8-4066-bc4e-3c85343b0856 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043189 May 12 20:59:25.449121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 765/1500] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:26.460616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:26.461529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:26.467742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:26.468187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:26.468939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:26.469398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:26.501485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7b2c7b5b-77e5-40ca-9d66-1872057a60db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045065 May 12 20:59:26.502045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 736/1501] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:27.514665 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:27.515506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:27.522849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:27.523297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:27.524060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:27.524497 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:27.553284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-87cff8be-49b7-4faa-95fa-ce690feb0b6e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042648 May 12 20:59:27.553862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 766/1502] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:28.564301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:28.565167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:28.572536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:28.572985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:28.573854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:28.574311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:28.605758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f3e4236-37d3-4fa3-9540-7c17bc8089ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045491 May 12 20:59:28.606333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 737/1503] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:29.617145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:29.618085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:29.624292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:29.624740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:29.629411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:29.629411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:29.656187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46bafdc4-8705-45e0-9100-dd19c2d71a19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043621 May 12 20:59:29.659071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 767/1504] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:30.855809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:30.856733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:30.862626 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:30.863073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:30.864325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:30.864905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:30.895139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aa0d12e4-991c-4810-b4d1-1c874c373d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.230814 May 12 20:59:30.895716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 738/1505] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:31.907428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:31.908355 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:31.915659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:31.916109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:31.917126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:31.917762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:31.948543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2173b814-cc69-4d40-bcc8-79622e3633c8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045085 May 12 20:59:31.949093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 768/1506] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:32.961054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:32.962093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:32.969636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:32.970094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:32.970924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:32.971386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:33.005672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f8433768-e7ad-4c90-8a90-fbd1d6f24e98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048900 May 12 20:59:33.006251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 739/1507] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:34.017573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:34.018519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:34.025796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:34.026252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:34.027013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:34.027451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:34.056770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c2202c2f-6b4d-4fad-9b22-d2a8f2115c13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043271 May 12 20:59:34.057340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 769/1508] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:35.068645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:35.069572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:35.076127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:35.076602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:35.077420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:35.077866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:35.107111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7c0dce11-5d09-4123-87aa-e437c6c03cfc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042515 May 12 20:59:35.107664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 740/1509] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:36.119265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:36.120178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:36.126462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:36.126906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:36.127659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:36.128089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:36.158723 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ef57a301-aa99-4bfa-83a9-c06e86b42ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043615 May 12 20:59:36.159284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 770/1510] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:37.170988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:37.171948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:37.179120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:37.179576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:37.180352 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:37.180824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:37.211659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-412a4c4c-b80d-46c3-9faa-3e910a747822 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044616 May 12 20:59:37.232691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 741/1511] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:38.242601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:38.243561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:38.250153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:38.250718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:38.251502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:38.251944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:38.286973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5c0d3ecf-cc7e-4d58-8b0c-c62b36afd467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048360 May 12 20:59:38.287561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 771/1512] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:59:39.299071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:39.299904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:39.306866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:39.307320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:39.308086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:39.308526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:39.337828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9777fe8f-ae22-41ff-8a18-5bdb7816244d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042840 May 12 20:59:39.338374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 742/1513] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:40.349649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:40.350580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:40.357042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:40.357529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:40.358286 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:40.358721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:40.388953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-219ca203-3300-4f54-90cd-35b079c1245a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043434 May 12 20:59:40.389544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 772/1514] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:41.401218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:41.402084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:41.408690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:41.409140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:41.409931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:41.410368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:41.439389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fb8101c6-2173-40d6-8755-2b353d2d5b20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042207 May 12 20:59:41.439931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 743/1515] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 20:59:41.519740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:59:41.520503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 20:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:59:42.451307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:42.452181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:42.459550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:42.459999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:42.460773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:42.461197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:42.490341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc850668-7920-4a48-8652-0df81ced5795 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043117 May 12 20:59:42.490900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 773/1516] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:43.502642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:43.503480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:43.510545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:43.510997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:43.511759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:43.512191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:43.542373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ce6f37ec-e974-4a5f-be60-d0098535e5ee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043939 May 12 20:59:43.542920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 744/1517] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:44.554901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:44.555768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:44.562151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:44.562618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:44.563556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:44.564018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:44.604925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-424f9080-fd4e-41f7-acb5-e5a30ad4b017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054616 May 12 20:59:44.605527 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 774/1518] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:45.618027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:45.618990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:45.626233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:45.626687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:45.627462 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:45.627924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:45.659608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-54b6c990-b609-4a29-91ee-6f437784170e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046966 May 12 20:59:45.660167 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 745/1519] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:46.671351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:46.672268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:46.678657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:46.679536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:46.679878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:46.680318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:46.709896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ed203b20-38e9-47cc-a9b6-88c1ed9888c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042522 May 12 20:59:46.715746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 775/1520] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:47.721802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:47.722643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:47.729672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:47.730157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:47.730933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:47.731372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:47.760592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dcc3125d-6520-4e50-aee8-639205002d89 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042895 May 12 20:59:47.761151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 746/1521] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:48.772928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:48.773794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:48.780103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:48.780554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:48.781340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:48.781773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:48.812436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a95264a9-6cd5-41e7-9717-2c2e326f4374 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044090 May 12 20:59:48.813007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 776/1522] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:49.824849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:49.825705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:49.832017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:49.832467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:49.833261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:49.833694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:49.864175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6b351099-f412-44ee-a56d-3033b5ae4877 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043181 May 12 20:59:49.864568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 747/1523] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:50.876137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:50.877057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:50.883647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:50.884097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:50.885120 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:50.885590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:50.915777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-47dd92d4-3a48-49cd-a781-7df2697075b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043634 May 12 20:59:50.916331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 777/1524] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:51.928133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:51.929059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:51.935453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:51.935906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:51.936668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:51.937105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:51.967922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9e47b375-7c5a-448a-9d56-2fe70a28afd2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044028 May 12 20:59:51.968492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 748/1525] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:52.980302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:52.981142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:52.987672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:52.988172 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:52.988884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:52.989349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:53.019722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6812a652-453f-41bc-b528-24206a16d55d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043448 May 12 20:59:53.020290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 778/1526] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:54.032090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:54.032924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:54.040005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:54.040463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:54.041240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:54.041710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:54.072044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6493bb82-f365-47f8-b613-c618af4c2b9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043987 May 12 20:59:54.072609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 749/1527] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:55.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:55.085490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:55.091961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:55.092422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:55.093210 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:55.093680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:55.123690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5ea179f3-40cc-4d8f-8aea-31efb40a7eae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043725 May 12 20:59:55.124259 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 779/1528] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:55.956619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 20:59:55.956811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 20:59:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 20:59:56.139379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:56.140914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:56.148513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:56.148959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:56.149757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:56.150217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:56.180853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-68885865-54fa-4d0a-bd0b-6fcf8f31d1cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048495 May 12 20:59:56.181424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 750/1529] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:57.192577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:57.193717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:57.200055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:57.200516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:57.201299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:57.201731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:57.231848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-eee406ed-bb35-4433-96f3-c208b2cbfe84 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043317 May 12 20:59:57.232387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 780/1530] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:58.244773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:58.245639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:58.252689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:58.253135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:58.253943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:58.254374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:58.286582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dd3955f8-fd4c-4793-949d-54dc61d7991a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046458 May 12 20:59:58.287137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 751/1531] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 20:59:59.298570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 20:59:59.299427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 20:59:59.306643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:59.307089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:59.307848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 20:59:59.308281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 20:59:59.337353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9d887db0-812e-481b-a309-f65e016e3773 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042784 May 12 20:59:59.337899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 781/1532] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 20:59:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:00.350215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:00.351177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:00.357590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:00.358038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:00.358801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:00.359236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:00.390271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a0a205ea-abff-41c4-8c0a-95a8ec27c47b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045124 May 12 21:00:00.390819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 752/1533] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:01.402144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:01.402966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:01.409774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:01.410228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:01.411494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:01.411931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:01.441866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-971d86ec-299e-4037-b764-fee403c81e69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043775 May 12 21:00:01.442901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 782/1534] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:02.454080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:02.454908 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:02.461501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:02.461948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:02.462703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:02.463138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:02.492955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49b4d4d4-a2c9-486b-b7c9-13e9f5b31578 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042920 May 12 21:00:02.493536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 753/1535] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:03.503997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:03.505422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:03.512092 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:03.512554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:03.513345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:03.513784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:03.543468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-739c52cb-67f5-4477-bb91-f93441681165 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043504 May 12 21:00:03.544013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 783/1536] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:04.555636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:04.556460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:04.562793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:04.563239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:04.563995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:04.564434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:04.593567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ce8e76ae-1582-4fd0-a166-fe6e90ff49ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042347 May 12 21:00:04.594079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 754/1537] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:05.605601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:05.606521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:05.612888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:05.613367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:05.614837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:05.615277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:05.644095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-30c37a86-ca6a-4ccf-9e3f-47be6ddf398e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042455 May 12 21:00:05.644651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 784/1538] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:06.656014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:06.656881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:06.664099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:06.664536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:06.665316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:06.665753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:06.697370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5412a79c-1e75-40ac-ab33-8a0b58086220 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045421 May 12 21:00:06.697923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 755/1539] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:07.709227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:07.710115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:07.716358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:07.716809 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:07.717594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:07.718030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:07.747086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5a789a3b-fbc2-4482-9722-6ad7b6d4c2b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041994 May 12 21:00:07.747638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 785/1540] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:08.759307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:08.760437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:08.766772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:08.767226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:08.767987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:08.768427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:08.800706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-17384da2-c2f2-48fb-b84f-1057dc97114d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045452 May 12 21:00:08.801431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 756/1541] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:09.813121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:09.814097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:09.820812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:09.821379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:09.822154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:09.822594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:09.853488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4fabe4a0-0e5c-447d-b7aa-7576835242da tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044491 May 12 21:00:09.854177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 786/1542] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:10.865245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:10.866188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:10.872736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:10.873185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:10.874007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:10.874442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:10.904051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cefd23bf-00c4-4505-bf1b-77e22bc10ccf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043766 May 12 21:00:10.904619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 757/1543] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:11.916203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:11.917162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:11.923547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:11.923997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:11.924764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:11.925200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:11.958007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-086e57f1-b1aa-4894-b9fa-ea406ecf7aae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045506 May 12 21:00:11.958581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 787/1544] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:12.970051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:12.970904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:12.978008 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:12.978466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:12.979251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:12.979695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:13.009539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9afa70ea-6210-4321-9589-7f3e4b879746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043483 May 12 21:00:13.010391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 758/1545] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:14.021659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:14.022490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:14.028721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:14.029164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:14.029964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:14.030393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:14.061797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-22777e09-0ceb-416c-b492-00ad7c25d4bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044252 May 12 21:00:14.062387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 788/1546] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:15.074408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:15.075247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:15.081924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:15.082376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:15.083145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:15.083577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:15.114579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-916cc486-1cb4-4e3f-9a08-dda7c106744f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043661 May 12 21:00:15.115152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 759/1547] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:16.127066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:16.128008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:16.134463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:16.135174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:16.135935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:16.136364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:16.166918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1c92395d-966c-4998-9902-6be6c06d9074 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043880 May 12 21:00:16.167608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 789/1548] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:17.179639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:17.180486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:17.186949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:17.187402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:17.188181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:17.188621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:17.220023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-36fd8d0a-18a4-4e26-a5dc-3abb7963faa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045082 May 12 21:00:17.220605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 760/1549] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:18.232227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:18.233056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:18.240069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:18.240520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:18.241309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:18.241746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:18.275443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1b3db14b-e95b-4273-9256-92cb9864cfb5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047215 May 12 21:00:18.276014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 790/1550] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:19.287111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:19.287949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:19.294277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:19.294722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:19.295481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:19.295915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:19.326870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1d3e64ce-b1fc-40b4-a2ac-4156007577c5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044340 May 12 21:00:19.327446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 761/1551] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:20.341646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:20.342585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:20.349453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:20.349917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:20.350702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:20.351145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:20.380917 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-884fa3a5-e468-4628-ae2b-e777da4715cd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043499 May 12 21:00:20.381513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 791/1552] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:21.392778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:21.393726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:21.401463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:21.401914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:21.402776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:21.403215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:21.436384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15ec8b91-126d-4e27-b0e0-4268ba95a1d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047566 May 12 21:00:21.436930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 762/1553] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:22.447945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:22.448877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:22.455189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:22.455663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:22.456423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:22.456875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:22.486926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d62eed6-df97-4212-bc21-585ad6118a8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042907 May 12 21:00:22.487482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 792/1554] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:23.498917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:23.499833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:23.506787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:23.507235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:23.507995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:23.508438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:23.538443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6e4f203c-f271-4b19-b0a4-1a6dd7e7c96a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043400 May 12 21:00:23.538991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 763/1555] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:24.550442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:24.552023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:24.558347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:24.558795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:24.559550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:24.559983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:24.590819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fc2b614e-e7f7-4923-8c7d-fccb163c33a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044789 May 12 21:00:24.591400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 793/1556] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:25.602768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:25.603687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:25.609914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:25.610356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:25.611114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:25.611546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:25.641977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af08fb21-b49b-4881-8f72-296c84cb9eb3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043226 May 12 21:00:25.642530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 764/1557] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:26.653758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:26.654808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:26.661233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:26.661916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:26.662694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:26.663131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:26.692211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7eacd61c-d6c1-4089-96a4-a581a40bab64 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042315 May 12 21:00:26.693564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 794/1558] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:27.704067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:27.704987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:27.712387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:27.712834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:27.713623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:27.714056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:27.744322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0986ad19-b53e-4408-8857-815e74fb0531 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044222 May 12 21:00:27.744882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 765/1559] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:28.756391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:28.757296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:28.763919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:28.764373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:28.765140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:28.765710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:28.797000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-73f198ec-3681-4f0a-9352-f1c8aaa38d19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044690 May 12 21:00:28.797594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 795/1560] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:29.809373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:29.810220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:29.816502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:29.816959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:29.817879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:29.818226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:29.847446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c7619461-97fd-4aae-ad7b-bbb7ba27d1a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042181 May 12 21:00:29.848004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 766/1561] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:30.860119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:30.861072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:30.868072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:30.868529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:30.869343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:30.869774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:30.899678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ba89757e-522d-4083-a22a-e302bbe983de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043501 May 12 21:00:30.900226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 796/1562] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:31.911395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:31.912331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:31.918880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:31.919335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:31.920095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:31.920529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:31.950476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-56b2dd4d-cc12-42a6-9636-ce82ede70413 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043146 May 12 21:00:31.951038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 767/1563] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:32.963312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:32.964153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:32.970613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:32.971060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:32.971826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:32.972257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:33.003067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-339516fb-d584-402e-a96f-b903be4e1b04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044192 May 12 21:00:33.003624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 797/1564] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:34.017627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:34.018464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:34.025573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:34.033845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:34.034665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:34.035099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:34.065431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-31e9bd29-33bc-434b-bb77-a973391baa17 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052902 May 12 21:00:34.067791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 768/1565] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:35.077867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:35.078718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:35.085133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:35.085614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:35.086389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:35.087462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:35.117711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a8a7cec-1c01-4d3b-99f5-f7c6b8f0370a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043804 May 12 21:00:35.118255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 798/1566] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:36.129480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:36.130319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:36.136977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:36.137461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:36.138284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:36.138758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:36.180210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-19cc648e-9a52-430e-9dbb-174a46d5030f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054874 May 12 21:00:36.180772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 769/1567] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:37.192027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:37.193483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:37.199820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:37.200267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:37.201021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:37.201486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:37.232388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2225d1c5-9917-4201-9cf7-8f6c38429191 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044384 May 12 21:00:37.232942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 799/1568] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:38.245016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:38.245887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:38.252311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:38.252762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:38.253559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:38.253998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:38.283086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c4d8e54-db55-49c3-b290-69ea939f5d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042120 May 12 21:00:38.283822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 770/1569] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:39.295648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:39.296581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:39.302949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:39.303393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:39.304245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:39.304677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:39.335356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-187ecc66-20f6-4815-974d-03a91180f6eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043522 May 12 21:00:39.335729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 800/1570] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:40.346815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:40.347405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:40.354603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:40.359829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:40.359829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:40.359829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:40.386720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2afeaca4-9cc0-4295-a727-2f9d9a1f9b4d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043210 May 12 21:00:40.386720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 771/1571] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:41.397910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:41.398744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:41.405425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:41.405932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:41.406708 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:41.407150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:41.438256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dbf30587-0417-4c2c-b503-6e9162ba4124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044538 May 12 21:00:41.438834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 801/1572] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:42.450181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:42.451024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:42.457845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:42.458300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:42.459088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:42.459526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:42.490456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4854d28e-e70c-4e23-bce4-49d7b41dba3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044295 May 12 21:00:42.491050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 772/1573] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:43.502384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:43.503215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:43.509716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:43.510419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:43.511174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:43.511606 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:43.541553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-13262b6e-b502-49f9-b5de-7f8a9aef7c6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043181 May 12 21:00:43.542121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 802/1574] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:44.554027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:44.554899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:44.560831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:44.561294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:44.562122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:44.562555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:44.592466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-de1baad2-510b-40aa-a827-04708c52c0fa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043559 May 12 21:00:44.593024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 773/1575] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:45.604559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:45.605486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:45.611737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:45.612187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:45.612944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:45.613403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:45.644026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-126384ff-168f-4592-9b32-82760f2b92b9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043483 May 12 21:00:45.644593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 803/1576] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:00:46.655905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:46.656747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:46.663694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:46.664139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:46.664962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:46.665444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:46.696702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-166dd5c5-28c0-4df6-934b-ea31f2e12071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044836 May 12 21:00:46.697267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 774/1577] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:47.708891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:47.709747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:47.716054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:47.716503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:47.717311 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:47.717754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:47.747775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-028cbc8d-4dcd-4e6a-b48e-78f3a1630311 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043481 May 12 21:00:47.748338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 804/1578] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:48.759362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:48.760454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:48.766917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:48.767371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:48.768148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:48.768592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:48.799236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ee52221c-2587-4e04-baf7-0e0fe445736f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044046 May 12 21:00:48.799795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 775/1579] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:49.812250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:49.813117 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:49.820387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:49.820835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:49.821562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:49.822002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:49.851631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ddc7f27e-2d5f-49be-84b8-36ed80c3c1c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043445 May 12 21:00:49.852189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 805/1580] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:50.863350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:50.864670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:50.871050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:50.871509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:50.872288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:50.872729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:50.903146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70955c56-c2ee-43ae-936a-03e020621ae6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043882 May 12 21:00:50.903705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 776/1581] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:51.914016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:51.915062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:51.921445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:51.921903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:51.922687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:51.923124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:51.952776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2d2d0b00-b9d1-4951-b068-fdef781fc691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042716 May 12 21:00:51.953356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 806/1582] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:52.964630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:52.965569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:52.972036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:52.972584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:52.974249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:52.974693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:53.005346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0d39b6dc-5271-482e-83f6-2287da070437 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045027 May 12 21:00:53.005912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 777/1583] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:54.017367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:54.018824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:54.027360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:54.028070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:54.029259 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:54.029965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:54.065846 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d3b4d9e-14c8-4e9d-9ca9-35237ffe1cd9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053484 May 12 21:00:54.066431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 807/1584] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:55.077247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:55.078251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:55.085421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:55.085872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:55.086648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:55.087085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:55.117505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a3b40836-66e5-468d-a409-d3f89d1cdbfb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044145 May 12 21:00:55.118065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 778/1585] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:56.128774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:56.130882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:56.137710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:56.138158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:56.138946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:56.139385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:56.168596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8f7d7d4d-efad-4e6b-b06b-62c033c73b3c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043968 May 12 21:00:56.169400 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 808/1586] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:57.180021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:57.181013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:57.187361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:57.187813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:57.188594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:57.189034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:57.219211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b636e9fb-ce95-4a18-b2fa-9b8e970e4559 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043078 May 12 21:00:57.219768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 779/1587] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:58.231110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:58.232088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:58.239199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:58.239661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:58.240452 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:58.240885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:58.271449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d0361dd-a1c8-4efe-bbb5-d107c187a05c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044458 May 12 21:00:58.272050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 809/1588] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:00:59.287078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:00:59.288007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:00:59.294357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:59.294818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:59.295594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:00:59.296041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:00:59.327331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cfd00cd2-a575-43ac-9aa6-e882005a0eaf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044869 May 12 21:00:59.327888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 780/1589] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:00:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:00.339334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:00.340304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:00.346657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:00.347039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:00.347893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:00.348341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:00.379087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e3d71b7b-7145-4ace-834d-eaa163f6e4c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043086 May 12 21:01:00.379920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 810/1590] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:01.391202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:01.392124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:01.399429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:01.399883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:01.400654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:01.401086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:01.430654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2ae6c8f0-34c2-4392-a088-e83930c5143b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043328 May 12 21:01:01.431206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 781/1591] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:02.442763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:02.443790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:02.450072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:02.450477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:02.451220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:02.451646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:02.481902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-07e3401c-aebb-4078-96b1-4e8d4c39d3fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043528 May 12 21:01:02.482447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 811/1592] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:03.493967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:03.494922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:03.503965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:03.504424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:03.505365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:03.505810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:03.535476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c7998750-938f-4288-b4f0-794ee82214ff tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045316 May 12 21:01:03.535965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 782/1593] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:04.546886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:04.547798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:04.554536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:04.554918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:04.555678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:04.556127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:04.586269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-59d6e487-4ee8-43d4-994c-660b42ec1433 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043232 May 12 21:01:04.586838 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 812/1594] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:05.598148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:05.599074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:05.605458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:05.605871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:05.606617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:05.607055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:05.637225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0e4de3f8-1dbc-4ffd-b138-b9097f37c815 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043331 May 12 21:01:05.637814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 783/1595] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:06.648976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:06.649944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:06.656204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:06.656648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:06.657717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:06.658150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:06.687784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5b6a0ad7-81d2-406b-b9aa-0be64a3a856a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043665 May 12 21:01:06.688257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 813/1596] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:07.699861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:07.700782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:07.707771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:07.708223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:07.708984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:07.709460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:07.738729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3c9fb026-affa-499f-92e0-a49f1dfcf88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042718 May 12 21:01:07.739221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 784/1597] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:08.749463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:08.750375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:08.757763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:08.758213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:08.758968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:08.759397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:08.789294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-de1f0ebe-42a6-4701-ad8e-c4e32ee17b7d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043708 May 12 21:01:08.789770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 814/1598] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:09.801667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:09.802597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:09.808927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:09.809414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:09.810184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:09.810641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:09.839439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-92ad2de7-7130-4704-8ba9-bbee91e9fd13 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042524 May 12 21:01:09.839997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 785/1599] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:10.851219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:10.852141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:10.858564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:10.859013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:10.859785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:10.860218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:10.890627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fccc0d3b-ed65-4d54-808b-ffea0e205376 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043490 May 12 21:01:10.891103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 815/1600] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:11.903041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:11.903971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:11.910582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:11.911034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:11.911806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:11.912245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:11.942331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e1e0b3f4-6a75-40f2-8f63-77173c657a9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043154 May 12 21:01:11.942809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 786/1601] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:12.953775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:12.954688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:12.961803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:12.962248 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:12.963000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:12.963428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:12.992450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1a1be9f-5f1b-4d61-8ec5-a30b8a8c358b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042492 May 12 21:01:12.992934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 816/1602] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:14.004328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:14.005230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:14.011552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:14.022250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:14.022250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:14.022250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:14.043904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d01cef8e-e06f-467f-a551-d90a6dddc771 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043601 May 12 21:01:14.044582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 787/1603] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:15.056171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:15.057102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:15.063502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:15.063954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:15.064726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:15.065159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:15.096414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9fcae54d-b678-4be6-bd15-b2b2ea863be0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044286 May 12 21:01:15.097058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 817/1604] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:16.108800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:16.109755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:16.116535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:16.116984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:16.117776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:16.118217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:16.148860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-451c924a-174c-4006-8d8d-7a82af385715 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043912 May 12 21:01:16.149445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 788/1605] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:17.160472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:17.162081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:17.168305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:17.168749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:17.169535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:17.169973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:17.199263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ccb7ea6a-b27f-49ae-9f0f-b47560980fcc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042663 May 12 21:01:17.199823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 818/1606] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:18.210984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:18.211925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:18.218942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:18.219395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:18.220158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:18.220587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:18.251440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3c6062f3-4c7f-4908-b1e0-8600b9c8a5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044336 May 12 21:01:18.252000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 789/1607] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:19.264278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:19.265195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:19.271748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:19.272201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:19.272961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:19.273428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:19.304425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4e911f4e-3c9e-4aa0-9b86-676372eb57b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044437 May 12 21:01:19.304975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 819/1608] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:20.315181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:20.316097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:20.323229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:20.323681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:20.324438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:20.324873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:20.356002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-25fb37f5-f93b-4e24-b9ce-a5e5037e1366 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044654 May 12 21:01:20.356576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 790/1609] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:01:21.367659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:21.368609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:21.374697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:21.375153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:21.375916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:21.376349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:21.407862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bd06543a-4d56-48d0-9f83-aee44b63659f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044105 May 12 21:01:21.408433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 820/1610] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:22.420531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:22.421495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:22.428348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:22.428798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:22.429677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:22.430116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:22.461181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-63a842e3-d7f8-45f3-b6fa-0f621df27a2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044554 May 12 21:01:22.461827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 791/1611] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:23.472856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:23.474526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:23.481187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:23.481674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:23.482446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:23.482886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:23.511683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9e7f0f72-e461-4a5e-822c-472b3f9185ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042696 May 12 21:01:23.512227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 821/1612] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:24.524166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:24.525099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:24.531473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:24.531923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:24.532688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:24.533126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:24.562585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfdeea3f-03cb-4105-87bf-c58df077945b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042963 May 12 21:01:24.563163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 792/1613] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:25.574572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:25.575475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:25.581773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:25.582226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:25.583075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:25.583511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:25.611869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-96359ca7-892d-4445-bfb2-67bdf0f6bd15 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041227 May 12 21:01:25.612413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 822/1614] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:26.624092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:26.625178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:26.633261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:26.633728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:26.634523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:26.635215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:26.670917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0d21e690-733f-4ceb-8ac1-b23e5b2d59d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050785 May 12 21:01:26.671474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 793/1615] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:27.402546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:01:27.403139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:01:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:01:27.685890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:27.686694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:27.694488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:27.694963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:27.695797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:27.696236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:27.727335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e750f6c8-1794-456c-b753-6a0fc6c0479d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047957 May 12 21:01:27.727890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 823/1616] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:28.738915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:28.739834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:28.746319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:28.746771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:28.747536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:28.747967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:28.778235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e941dde2-108b-4bba-9c6c-34442a9dfab3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043849 May 12 21:01:28.779035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 794/1617] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:29.790650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:29.791480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:29.797712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:29.798165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:29.798937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:29.799556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:29.830914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0e83573e-a19d-4e67-a02a-08d4d9218cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044485 May 12 21:01:29.831477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 824/1618] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:30.842680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:30.843594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:30.851003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:30.851456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:30.852226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:30.852683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:30.881921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5fc09665-dd0a-4330-9152-ba92b3d2a60c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043211 May 12 21:01:30.882476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 795/1619] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:31.893746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:31.894723 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:31.901300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:31.901761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:31.902648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:31.902958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:31.934985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-313b5442-fae3-4966-b6f6-4aa84c49b7f8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045130 May 12 21:01:31.935539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 825/1620] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:32.378494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:01:32.379124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:01:32.947715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:32.948641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:32.954913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:32.955379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:32.956136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:32.956574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:32.986757 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0850a595-1b77-44da-9b63-1a06e9e09858 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043005 May 12 21:01:32.987315 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 796/1621] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:34.001354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:34.002318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:34.009144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:34.009633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:34.010672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:34.011116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:34.046933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5270c182-c76c-4310-8052-a1da43ee865c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049790 May 12 21:01:34.047550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 826/1622] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:35.058287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:35.059206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:35.065463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:35.065914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:35.066752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:35.067184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:35.095211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ea2f6e94-54ff-4f43-993b-0dcaec7bda91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.040837 May 12 21:01:35.095751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 797/1623] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:36.107467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:36.108394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:36.115337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:36.115727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:36.116492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:36.116927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:36.146934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d6e3b377-d9ba-46dc-a5d2-dae7c848cc44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043304 May 12 21:01:36.147503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 827/1624] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:37.158655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:37.159478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:37.165834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:37.166317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:37.167074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:37.167516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:37.196750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-658c516a-2826-46ac-a5ca-22ab2487a64b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042081 May 12 21:01:37.197337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 798/1625] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:38.208899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:38.209857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:38.216139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:38.216591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:38.217397 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:38.217833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:38.246806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-288514dc-e02a-4d5f-b655-58026e646510 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042671 May 12 21:01:38.247360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 828/1626] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:39.258490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:39.259446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:39.266078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:39.266529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:39.267291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:39.267731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:39.296679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-72462167-335f-4b1b-8a75-763f8ce43f98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042124 May 12 21:01:39.297286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 799/1627] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:40.308892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:40.309954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:40.316787 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:40.317719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:40.318169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:40.318689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:40.348625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-75f819ac-bd71-4f1e-a980-d0dbefc668a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043668 May 12 21:01:40.349167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 829/1628] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:41.359958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:41.360882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:41.367278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:41.367732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:41.368494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:41.368934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:41.398711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e0e4d80f-c227-4568-aa94-f057d98e8800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042654 May 12 21:01:41.399259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 800/1629] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:41.615419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:01:41.615643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:01:42.409925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:42.410919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:42.417551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:42.418013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:42.418790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:42.419228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:42.448758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8015a5d8-1ef8-4af3-8f3e-bb3de2ff88a1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042758 May 12 21:01:42.449251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 830/1630] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:43.460639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:43.461591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:43.467599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:43.468049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:43.468809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:43.469242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:43.499401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d919e7c9-426a-491e-93b2-4addb6ee1a11 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043355 May 12 21:01:43.499948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 801/1631] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:44.512226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:44.513150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:44.519438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:44.519885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:44.520771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:44.521167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:44.549331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a0ebb233-30d7-417c-b985-89107a835b8e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041241 May 12 21:01:44.549882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 831/1632] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:45.560515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:45.561478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:45.567736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:45.568185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:45.568951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:45.569424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:45.597836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ba4d3bf6-1e83-493e-b079-b31140cdc0b0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041061 May 12 21:01:45.598906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 802/1633] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:01:46.610074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:46.611173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:46.617766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:46.617995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:46.618766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:46.619204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:46.649506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d7ed30e8-6f90-4f82-922a-cda6c5fb60d0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043249 May 12 21:01:46.650070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 832/1634] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:47.660719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:47.661737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:47.669051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:47.669537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:47.670306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:47.670739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:47.700707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2efdccd9-3e30-45cf-a083-489e13780501 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043864 May 12 21:01:47.701264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 803/1635] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:48.712503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:48.713458 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:48.719734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:48.720185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:48.720950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:48.721413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:48.751746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08e7bd76-68e2-4d5f-b067-bfa811fa47d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043277 May 12 21:01:48.752309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 833/1636] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:49.763924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:49.764873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:49.771261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:49.771714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:49.772488 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:49.773461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:49.802895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-37f2dbcc-02b1-4eed-859d-06f3a971a1df tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043216 May 12 21:01:49.803451 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 804/1637] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:50.730544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:01:50.731201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:01:50.814937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:50.815860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:50.821895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:50.822352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:50.823124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:50.823559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:50.854066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-29c3c6b9-e1ea-437a-ab47-39130df55c27 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043008 May 12 21:01:50.854614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 834/1638] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:51.870161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:51.871091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:51.878007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:51.878454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:51.879221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:51.879654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:51.910309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-64cafdec-db33-46b9-aaea-cf36d1920841 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047493 May 12 21:01:51.910869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 805/1639] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:52.921207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:52.922147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:52.928439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:52.928886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:52.929678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:52.930501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:52.960706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11248fb7-e72c-416b-8ccc-6afc1b51d9c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043329 May 12 21:01:52.961839 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 835/1640] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:53.972133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:53.973053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:53.980605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:53.981056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:53.982181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:53.982614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:54.015247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-07f35123-a04c-4808-88bf-715498a32cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047189 May 12 21:01:54.015802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 806/1641] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:55.027335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:55.028262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:55.034506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:55.035028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:55.035890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:55.036332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:55.065572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-094f386b-421f-41e6-9818-01d273d2ce88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042501 May 12 21:01:55.066127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 836/1642] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:56.077133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:56.078024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:56.084226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:56.084689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:56.085478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:56.085917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:56.116923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-73df0fd7-7305-46ce-be24-b44eb2553628 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043704 May 12 21:01:56.118206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 807/1643] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:57.127931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:57.128886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:57.135410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:57.135858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:57.136630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:57.137066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:57.167079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8e39f2a2-e729-4900-b512-9a6a9f449e9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043020 May 12 21:01:57.167620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 837/1644] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:58.178857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:58.179771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:58.186526 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:58.187047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:58.187890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:58.188389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:58.218760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-77e00bb8-2262-47c0-8bf2-c93c88a14e51 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043782 May 12 21:01:58.219371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 808/1645] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:01:59.231360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:01:59.232314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:01:59.238710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:59.239163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:59.239926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:01:59.240364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:01:59.270924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4da1c9ab-58e0-4bcf-83e5-cd6641efcf53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044132 May 12 21:01:59.271481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 838/1646] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:01:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:00.282501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:00.283427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:00.290233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:00.290730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:00.291608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:00.292038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:00.321250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e87f89e6-ef52-4ff5-b373-25a46642654a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042609 May 12 21:02:00.322404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 809/1647] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:01.333423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:01.334547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:01.342181 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:01.342629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:01.343394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:01.343975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:01.375975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2013c7eb-4d62-446e-81a2-f76c8f1c0fed tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046424 May 12 21:02:01.376521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 839/1648] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:02.388515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:02.389473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:02.395741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:02.396191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:02.396957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:02.397430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:02.427689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4902da4a-cd28-4611-9ae7-0d6585caf8ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044096 May 12 21:02:02.428243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 810/1649] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:03.439778 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:03.441297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:03.448485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:03.448949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:03.449756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:03.450285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:03.480564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d5d844ee-0944-41d1-ae65-c263460f8868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044686 May 12 21:02:03.481110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 840/1650] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:04.491977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:04.492891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:04.499570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:04.500016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:04.500776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:04.501207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:04.531456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f5852fa3-a9d4-4893-808f-57484694bd58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043370 May 12 21:02:04.532015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 811/1651] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:05.543475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:05.544460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:05.550968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:05.551423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:05.552183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:05.552616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:05.583131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2be58ebb-a11d-43ef-aa4e-018f1bda1537 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044160 May 12 21:02:05.583690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 841/1652] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:06.597146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:06.598135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:06.605433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:06.605917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:06.606692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:06.607130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:06.636864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a6c1dbc9-d40e-4963-9016-f25446968af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043600 May 12 21:02:06.637450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 812/1653] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:07.648020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:07.649067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:07.655710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:07.656162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:07.656924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:07.657386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:07.689263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fe4e84e3-4d17-4487-aac3-2134392d0285 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045180 May 12 21:02:07.689849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 842/1654] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:08.709665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:08.710597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:08.718911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:08.719368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:08.720437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:08.721419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:08.761544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bed239af-8a4e-4a9f-83f2-80fe1813cde2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065147 May 12 21:02:08.762112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 813/1655] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:09.773205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:09.776175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:09.782526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:09.782979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:09.783740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:09.784195 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:09.814137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-62534e8a-b82d-42f6-8fda-503e95d368dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044908 May 12 21:02:09.814691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 843/1656] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:10.826342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:10.827273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:10.833939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:10.834399 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:10.835191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:10.835633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:10.870461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e8ca8cef-bc96-4206-9f40-a4385347bdf6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048420 May 12 21:02:10.871059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 814/1657] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:11.882042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:11.882970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:11.889735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:11.890189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:11.890961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:11.891404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:11.922069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c7b6a65d-04da-43ef-9fea-5927341bfe9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043861 May 12 21:02:11.922747 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 844/1658] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:12.934214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:12.935149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:12.941853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:12.942317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:12.943115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:12.943556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:12.975092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-32ce7525-5e2b-4291-8272-ca8aee2b8864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045538 May 12 21:02:12.975656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 815/1659] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:13.996950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:13.997928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:14.004264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:14.004719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:14.005518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:14.005953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:14.036746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a874519-cd44-459e-a3bd-9dd9e812041a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052535 May 12 21:02:14.037319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 845/1660] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:15.048242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:15.049205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:15.055523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:15.056019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:15.057346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:15.057785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:15.088243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0b67296e-7540-4dd4-916f-b7f4ef1fa5d6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043882 May 12 21:02:15.088793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 816/1661] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:16.101994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:16.102918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:16.110027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:16.110480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:16.111254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:16.111694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:16.143569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cca3fd86-3e03-4eb3-8c28-dd4206bca0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046396 May 12 21:02:16.144155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 846/1662] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:17.162387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:17.163316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:17.170275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:17.170731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:17.171636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:17.171920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:17.203686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9453a910-4ae0-4d57-bf91-4802c4cb442b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053267 May 12 21:02:17.204272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 817/1663] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:18.216307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:18.217239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:18.223659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:18.224274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:18.224984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:18.225408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:18.254504 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46a0ae95-7152-4efa-be66-f79a51f82392 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042675 May 12 21:02:18.255057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 847/1664] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:19.266190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:19.267153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:19.273578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:19.274037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:19.274806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:19.275239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:19.308596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-59a231fa-e760-477f-b713-f11192d6a4a8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046445 May 12 21:02:19.309170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 818/1665] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:20.321602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:20.324904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:20.331507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:20.331960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:20.332729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:20.333160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:20.364042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1222616-e63d-4615-b2bd-3854f1316b4c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046942 May 12 21:02:20.364606 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 848/1666] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:21.375263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:21.376188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:21.382718 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:21.386162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:21.387577 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:21.388025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:21.419206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d26b91b4-c584-4951-ae4a-03f1712aa643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047850 May 12 21:02:21.419783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 819/1667] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:22.431245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:22.432300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:22.438854 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:22.439313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:22.440143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:22.440531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:22.471817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-304f4975-f6a8-4210-a1f0-1715d50fb959 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044734 May 12 21:02:22.472848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 849/1668] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:23.484013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:23.485034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:23.491999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:23.492521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:23.493302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:23.493926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:23.526009 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-755b05a2-39a2-41fc-aec8-0838f8f5500f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046503 May 12 21:02:23.530561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 820/1669] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:24.538517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:24.540115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:24.548959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:24.549703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:24.550989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:24.551698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:24.592501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-93facbd5-f4b4-4542-8c28-8dc250bf2f1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058079 May 12 21:02:24.593068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 850/1670] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:25.604497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:25.606146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:25.612694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:25.613094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:25.614088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:25.614408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:25.658663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c85f5023-fe35-4b60-9860-a63ecd3cd527 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058408 May 12 21:02:25.659251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 821/1671] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:26.678925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:26.681049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:26.690669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:26.691205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:26.692030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:26.692464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:26.734376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4af248ef-d094-4c44-a8b3-b9a28cafb0a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067734 May 12 21:02:26.735052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 851/1672] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:27.747025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:27.747967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:27.754452 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:27.754905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:27.755693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:27.756121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:27.789202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b7a411e8-27a3-4b17-b94a-6a2d533b03d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046567 May 12 21:02:27.789830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 822/1673] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:28.801784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:28.802772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:28.809417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:28.809875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:28.810666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:28.811359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:28.842603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e3c985c7-13a7-4c7e-b130-66ec336c33bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044988 May 12 21:02:28.843175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 852/1674] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:29.855032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:29.856847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:29.865000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:29.865684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:29.866624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:29.867060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:29.898284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-97a93d52-82ac-4837-be3d-fedf9ae3ae40 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047952 May 12 21:02:29.898845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 823/1675] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:30.917630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:30.920435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:30.928446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:30.928957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:30.929841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:30.930221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:30.962477 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8f68e106-b3fa-4699-b26f-7c2cd8d9168b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053561 May 12 21:02:30.963059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 853/1676] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:31.977746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:31.978667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:31.985756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:31.986212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:31.986986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:31.987422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:32.019247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1bb8ce5c-a7c5-464d-a7ab-1552972a71e9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045330 May 12 21:02:32.019838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 824/1677] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:33.031883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:33.032869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:33.039581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.040027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.040801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.041247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.067939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:33.068528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:33.072179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-802d7272-5a49-4c45-9246-897d2df0e38c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044201 May 12 21:02:33.073393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 854/1678] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:33.075737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.076195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.076961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.077417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.091092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 HTTP/1.1 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Openstack-Nova-Api-Version: 2.20 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:02:33.092679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.094589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90'} May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:02:33.095465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.096867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:02:33.098254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:02:33.098254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6ac8193f-0ef2-4b34-b77d-1f4d95554c4d tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 404 len: 111 microversion: 2.20 time: 0.030055 May 12 21:02:33.098254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 825/1679] 10.222.0.59 () {60 vars in 1279 bytes} [Thu May 12 21:02:33 2022] DELETE /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 21:02:33.102391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:33.102996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] [instance: a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:33.109576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.110028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.110789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:33.111218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:33.125383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] HTTP exception thrown: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Request method failure captured: May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 HTTP/1.1 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAuBA9QAItr9Lz-2Yi4gRBjeYefhb7UhUe-H8V-IxZA1kbo5rDPwyWBhqr8XqVDp1t3sc7t3MVYYHF7kh0vZuEixEXS8uVKyITUQr178z5ErRrjAd-4_sl8ds1UPaKk27Jas6N8O-_KOodvJwFjZBZWFMg-f-aALeOdoiJ66VOOw74 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Openstack-Nova-Api-Version: 2.20 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: e3bcc803e53f46efb996577417eca77a May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 21:02:33.126849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3bcc803e53f46efb996577417eca77a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3bcc803e53f46efb996577417eca77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: e3bcc803e53f46efb996577417eca77a May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-563566109 May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 64ce721d7163430dbf31ffbbf28c2094 May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-563566109-project May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.128634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': 'a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90'} May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:02:33.129581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. May 12 21:02:33.131045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:02:33.132408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] Returning 404 to user: Instance a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:02:33.132408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-49b87517-6e6f-46fc-a6af-599fbcd2b129 tempest-AttachVolumeShelveTestJSON-563566109 tempest-AttachVolumeShelveTestJSON-563566109-project] 10.222.0.59 "GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90" status: 404 len: 111 microversion: 2.20 time: 0.029914 May 12 21:02:33.132408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 855/1680] 10.222.0.59 () {60 vars in 1276 bytes} [Thu May 12 21:02:33 2022] GET /compute/v2.1/servers/a00aec6d-fa6a-4ac0-b915-f68c5c2f5c90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 21:02:34.066432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:34.066935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:34.074584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.075222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.075802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.076236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.087919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:34.090325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:34.104470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.105032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.106312 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.106529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.113326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 21:02:34.137726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2e8947fa-e176-4ebf-8402-d63fd9acd26f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055601 May 12 21:02:34.138668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 856/1681] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:34.533530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-21fb7d9e-2738-4781-b9f7-a57472556883 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 204 len: 0 microversion: 2.1 time: 0.470730 May 12 21:02:34.537740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 826/1682] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:02:34 2022] DELETE /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 21:02:34.543457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:34.544419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:34.552975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.553476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.554270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:34.554720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:34.909558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:34.919691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5420fecf-67a8-487b-8c0b-eb06875aadc8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.380373 May 12 21:02:34.920515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 857/1683] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:35.153242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:35.154683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:35.169616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:35.182477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:35.184016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:35.184554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:35.220380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfeb8046-f594-4b80-9754-dcafa6499eba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.072171 May 12 21:02:35.221134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 827/1684] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:35.936074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:35.936779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:35.943369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:35.945848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:35.946870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:35.947320 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:36.232022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:36.232249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:36.233778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:36.240353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:36.240691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-71ea3e09-a7ec-4139-88e6-04325dca3181 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.308458 May 12 21:02:36.240841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:36.241295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 858/1685] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:35 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:36.241547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:36.241994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:36.278737 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dd4282ed-ea31-433f-aa1f-93c888b74f70 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050391 May 12 21:02:36.279313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 828/1686] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:37.258712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:37.260255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:37.266876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:37.267333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:37.268182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:37.268554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:37.290482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:37.292064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:37.299237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:37.299696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:37.300489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:37.300929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:37.336012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-431eaced-4e93-49ba-b272-154a82152176 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049299 May 12 21:02:37.336591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 829/1687] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:37.704338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:37.714559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8b2dc7bb-e8f0-4c32-97dd-4993b2c39c77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.459733 May 12 21:02:37.715145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 859/1688] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:38.350541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:38.350541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:38.357660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:38.358122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:38.358896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:38.359356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:38.390423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-62b73e95-f969-4c3b-afa6-1af126e0d44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046056 May 12 21:02:38.391000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 830/1689] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:38.733773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:38.734536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:38.741071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:38.741603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:38.742389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:38.742961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:38.879944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:38.892439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dfadba86-5b1b-44ee-bb1b-72b71f4ee3c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.163866 May 12 21:02:38.892994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 860/1690] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:39.411011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:39.412044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:39.419273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:39.419727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:39.420508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:39.420947 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:39.453418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3fe1b16b-65ef-479d-8ac1-cfce9bd0ac3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051589 May 12 21:02:39.454086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 831/1691] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:39.910083 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:39.910615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:39.917533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:39.917987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:39.918763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:39.919196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:40.070308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:40.080197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-174058f4-7ef8-4eb3-9d7c-0324fec137e3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.174039 May 12 21:02:40.080775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 861/1692] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:40.465555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:40.466480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:40.472892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:40.473383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:40.474202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:40.474688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:40.506664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c42e1b89-940e-400f-ad08-9b5470c5f1dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045158 May 12 21:02:40.511197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 832/1693] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:41.097930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:41.098571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:41.110331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:41.110331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:41.110331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:41.110331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:41.249881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:41.258571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0d9eb3cd-b49b-4715-b3fb-5c285fb15a12 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164666 May 12 21:02:41.259190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 862/1694] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:41 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:41.521233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:41.522147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:41.529835 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:41.530280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:41.531037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:41.531469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:41.562502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-11c58a72-1bca-4a01-823f-8192b1910153 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045352 May 12 21:02:41.563301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 833/1695] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:42.278992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:42.279610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:42.286221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:42.286672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:42.287450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:42.287885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:42.427187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:42.436479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6477431e-ba4c-472e-9bbe-9b55b6e8552b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161519 May 12 21:02:42.437062 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 863/1696] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:42 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:42.573935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:42.575031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:42.582061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:42.582525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:42.583356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:42.583807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:42.621028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b245945a-bc44-4250-b890-77c41c5e79d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050932 May 12 21:02:42.621648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 834/1697] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:43.456079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:43.456676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:43.464289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:43.465047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:43.465934 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:43.466372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:43.606482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:43.615751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c3472907-70dd-4dd6-a3ac-ad05966323aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164583 May 12 21:02:43.616328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 864/1698] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:43.632161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:43.633093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:43.640030 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:43.640482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:43.641261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:43.641733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:43.671944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-76e2e343-1e63-4bbd-b0e6-863484b5e314 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043847 May 12 21:02:43.672521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 835/1699] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:44.633268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:44.634079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:44.641464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:44.641914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:44.642682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:44.643116 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:44.685240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:44.686202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:44.692959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:44.693433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:44.694212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:44.694642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:44.732147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5dca1789-3925-414f-b446-569153633888 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051710 May 12 21:02:44.732809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 836/1700] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:44.781110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:44.788817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1dd115bd-c036-40ba-bf09-a657e938bdc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159611 May 12 21:02:44.789404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 865/1701] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:45.744104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:45.745023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:45.751822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:45.752543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:45.753342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:45.753776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:45.787394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-55736a49-ee94-4694-9d40-ec663af2f3ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047349 May 12 21:02:45.787967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 837/1702] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:45.806076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:45.806785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:45.813133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:45.818470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:45.818470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:45.818470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:45.963779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:45.976580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0577add1-29ef-46d1-a620-925946f784b0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.174059 May 12 21:02:45.977551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 866/1703] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:46.799444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:46.800363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:46.806792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:46.807239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:46.807999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:46.808513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:46.840674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-23c9c74e-6aa5-4cf0-bbab-9e871217048e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044443 May 12 21:02:46.844396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 838/1704] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:46.996932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:46.997516 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:47.004946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:47.005422 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:47.006189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:47.006621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:47.147176 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:47.156553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-82c037ee-4a9b-42f9-9cf0-df359f435b46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.163450 May 12 21:02:47.157140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 867/1705] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:47.852867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:47.853891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:47.861611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:47.862162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:47.862957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:47.863394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:47.895855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2ef18908-72f6-4db7-a56f-c4234c9c559a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046861 May 12 21:02:47.896430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 839/1706] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:48.174899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:48.175482 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:48.181901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:48.182351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:48.183114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:48.184227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:48.324373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:48.331956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1f9c3725-8f46-4c2b-af22-f743fbb69821 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160925 May 12 21:02:48.332525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 868/1707] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:48.908949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:48.909883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:48.916152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:48.916586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:48.917374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:48.917831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:48.948419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0f8358fb-2f00-4292-9300-4f89016ef843 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043418 May 12 21:02:48.948984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 840/1708] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:49.348807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:49.349485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:49.355693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:49.356133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:49.357085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:49.357711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:49.503994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:49.512342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e914d843-fac7-49bd-a172-8865c75a9ebc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.167344 May 12 21:02:49.512904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 869/1709] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:49 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:49.960154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:49.961151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:49.968141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:49.968702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:49.969522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:49.969953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:50.002121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ddbbf2b4-66e3-44c0-a25c-1f90fef27d2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045873 May 12 21:02:50.002708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 841/1710] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:50.531884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:50.532700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:50.538711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:50.539154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:50.539919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:50.540349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:50.673926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:50.684285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-40fab95f-e474-428c-b044-ca33f5a05ddc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157571 May 12 21:02:50.684862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 870/1711] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:51.015615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:51.016584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:51.023134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:51.023583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:51.024342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:51.024775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:51.056229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6825d5eb-f0d5-476f-bdb0-2616c277be69 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045494 May 12 21:02:51.056789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 842/1712] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:51.702364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:51.702977 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:51.709645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:51.710097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:51.710863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:51.711290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:51.847243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:51.855647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-79e669c9-e006-4b68-aca0-b9d4956535fc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157097 May 12 21:02:51.856228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 871/1713] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:52.068358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:52.069187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:52.075575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:52.076021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:52.077537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:52.078153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:52.109512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-17e4272a-c641-4e81-a763-728987f4e40b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045027 May 12 21:02:52.110099 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 843/1714] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:52.872669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:52.873372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:52.880522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:52.880959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:52.881743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:52.882175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:53.012261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:53.020349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f0a598ee-4e07-4482-b865-f0d89b1955e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151668 May 12 21:02:53.020923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 872/1715] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:52 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:53.121784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:53.122657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:53.129006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:53.129517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:53.130287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:53.130728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:53.161733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3c130dbd-9df5-4c20-80bf-285213d8e1ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044006 May 12 21:02:53.162297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 844/1716] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:54.037920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:54.038536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:54.044902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:54.046265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:54.047215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:54.047582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:54.174033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:54.174990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:54.181316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:54.181774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:54.182555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:54.182990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:54.183930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:54.191938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-646bc313-56a6-4817-a044-e309a5bda970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157789 May 12 21:02:54.192525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 873/1717] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:54.213675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-79906275-f70d-4239-8eaf-ebd209a85d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043813 May 12 21:02:54.214256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 845/1718] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:55.209060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:55.209684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:55.216145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:55.216594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:55.217420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:55.217860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:55.226350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:55.227223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:55.234833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:55.235166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:55.236087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:55.236468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:55.269976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1acc73d5-b47d-4770-8a56-c1437cae3530 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047587 May 12 21:02:55.270547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 846/1719] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:02:55.354519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:55.362955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5a0f16c9-5427-4d24-a96c-9fef24dbbd91 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157789 May 12 21:02:55.363567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 874/1720] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:56.282971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:56.283800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:56.290232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:56.290665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:56.291429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:56.291857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:56.321998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c438d525-6159-4d03-ad0e-2ab572c0a842 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044065 May 12 21:02:56.322605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 847/1721] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:56.379867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:56.380505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:56.387372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:56.388063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:56.388530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:56.389479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:56.524322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:56.533049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-636ee586-e180-4339-85c7-0b3ccd1f9a6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156977 May 12 21:02:56.533579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 875/1722] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:57.334273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:57.335185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:57.341467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:57.342569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:57.343966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:57.344405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:57.373925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f109950-c821-47e9-9f0a-ad61df6794c4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043027 May 12 21:02:57.374496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 848/1723] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:57.549871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:57.550611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:57.557706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:57.558262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:57.559217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:57.559714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:57.691224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:57.699133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-874f610f-298e-4184-b470-be243b51d8a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153280 May 12 21:02:57.699712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 876/1724] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:58.385379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:58.386296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:58.392605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:58.393057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:58.393848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:58.394286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:58.424227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4f6e2fd1-373c-4b5b-b2bc-83731a8e4979 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043068 May 12 21:02:58.424789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 849/1725] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:58.717649 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:58.718343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:58.724467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:58.724915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:58.725712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:58.726140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:58.860743 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:02:58.868600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af02be35-41b4-4b04-a019-1d8c9a0e8722 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155525 May 12 21:02:58.869159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 877/1726] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:02:59.436563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:59.437796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:59.444192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:59.444622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:59.445418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:59.445864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:59.475482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a1ec7a32-1256-489b-bcb2-a5ae4c5bf3b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043784 May 12 21:02:59.476044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 850/1727] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:02:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:02:59.886021 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:02:59.886620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:02:59.893528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:59.893972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:02:59.894728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:02:59.895154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:00.024135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:00.032414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d6da1f4-1197-474d-954a-9f54705d6c33 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150486 May 12 21:03:00.033318 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 878/1728] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:02:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:00.487404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:00.488321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:00.495055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:00.495509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:00.496266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:00.496704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:00.526141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3dce2339-eb3b-4bd7-9fe4-eaec43b2f5a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043412 May 12 21:03:00.526690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 851/1729] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:01.050317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:01.050954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:01.057326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:01.057783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:01.058559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:01.058993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:01.192032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:01.200348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-650f678d-fb9c-4ca9-aebd-3c25d7a77e96 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153967 May 12 21:03:01.200915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 879/1730] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:01.528756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:03:01.529435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:03:01.538762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:01.540638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:01.548810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:01.549250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:01.550042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:01.550472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:01.583846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60acd5ff-ae80-45ed-a710-f5940e34afaa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048958 May 12 21:03:01.584438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 852/1731] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:02.218984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:02.219590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:02.226293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:02.226733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:02.227486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:02.227916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:02.377136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:02.385457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-70462f75-a188-46aa-a8f2-50445e8ffc31 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.170932 May 12 21:03:02.385956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 880/1732] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:02.595847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:02.596775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:02.603123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:02.603578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:02.604345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:02.604813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:02.635898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-97c56ee5-af77-4d42-9598-5624aaa682be tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044006 May 12 21:03:02.636368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 853/1733] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:03.402651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:03.403289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:03.410677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:03.411127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:03.411893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:03.412339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:03.545163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:03.553486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-56310ef3-e87d-402b-ac99-626148d20ca9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154601 May 12 21:03:03.554070 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 881/1734] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:03 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:03.648416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:03.649354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:03.655899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:03.656357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:03.657126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:03.657588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:03.687130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-42f15457-bd29-40a5-9db0-abc5fa7d547d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042611 May 12 21:03:03.687697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 854/1735] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:04.571459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:04.572387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:04.580481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:04.580927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:04.581728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:04.582162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:04.700283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:04.702843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:04.711300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:04.711762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:04.712766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:04.713216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:04.728951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:04.736957 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-84190ae2-d84c-4f17-b2fd-e44aedbb3649 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.169512 May 12 21:03:04.737558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 882/1736] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:04.745884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-62d8f53c-b26c-4e82-bbb2-9d399a90bd2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050723 May 12 21:03:04.746714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 855/1737] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:05.755514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:05.756067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:05.757000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:05.758039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:05.762447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:05.762898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:05.764955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:05.765412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:05.765561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:05.765903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:05.766969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:05.767844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:05.800349 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-777e24ee-a64f-44d8-bcb4-490c81d43cf7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047279 May 12 21:03:05.800925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 856/1738] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:05.904627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:05.912606 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-889ea7ca-b589-4c33-a1f3-424257e033d3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161292 May 12 21:03:05.913171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 883/1739] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:06.812497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:06.813514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:06.820194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:06.828583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:06.828583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:06.828583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:06.851950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9a6536a6-ce7e-4e05-8979-af70010d2af8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043685 May 12 21:03:06.852506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 857/1740] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:06.934761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:06.935558 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:06.942402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:06.942828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:06.943604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:06.944038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:07.089372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:07.099254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-88c30f8c-e8cc-4d6a-ac6e-3565578690f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.168375 May 12 21:03:07.099873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 884/1741] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:06 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:07.863630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:07.864794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:07.871236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:07.871691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:07.872501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:07.873619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:07.903714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d8042445-6283-4ac6-a2dd-6ed5afd9572c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044007 May 12 21:03:07.904792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 858/1742] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:08.117559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:08.118147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:08.124726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:08.125163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:08.125964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:08.126396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:08.261870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:08.271185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c15183c2-74bc-43de-96ef-2f036f0accc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157479 May 12 21:03:08.271768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 885/1743] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:08.915996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:08.916932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:08.923978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:08.924423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:08.925190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:08.925650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:08.956285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b5f56a81-c70b-442a-91ef-92867b926a82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044166 May 12 21:03:08.956932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 859/1744] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:09.294473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:09.295411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:09.304739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:09.305194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:09.306012 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:09.306451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:09.436790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:09.444529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b79659e3-99ac-47b2-ac3a-d739eba95065 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154149 May 12 21:03:09.445084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 886/1745] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:09.968812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:09.969696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:09.976021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:09.976463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:09.977260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:09.977715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:10.007922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-db226451-b2d1-48f7-a998-d60b8e02d000 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043616 May 12 21:03:10.008482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 860/1746] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:10.462270 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:10.462887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:10.470139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:10.470587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:10.471376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:10.471806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:10.605139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:10.614015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-320c9968-fd18-4e8c-a167-c36757d9e194 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155605 May 12 21:03:10.614588 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 887/1747] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:10 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:11.020565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:11.021538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:11.027851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:11.028299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:11.029233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:11.029785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:11.061046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ac847ad0-cabc-41da-831b-a2ea867d35ae tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044390 May 12 21:03:11.061831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 861/1748] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:11.632162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:11.632759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:11.640022 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:11.640469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:11.641229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:11.641676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:11.773368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:11.782833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7fb752cd-93db-4541-8618-6907a6aa00fe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154503 May 12 21:03:11.783415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 888/1749] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:12.073021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:12.074118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:12.081250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:12.081820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:12.082705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:12.083151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:12.114839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b5ada369-a3f1-4a2f-b73b-9bcfeea6f7d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045977 May 12 21:03:12.115406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 862/1750] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:12.806682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:12.807236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:12.814810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:12.815258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:12.816024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:12.816457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:12.961222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:12.969919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-09391683-7a22-4a87-91f4-edffecf426a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.167149 May 12 21:03:12.970500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 889/1751] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:13.127731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:13.128663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:13.135435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:13.137388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:13.137388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:13.137388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:13.174431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dd050fed-7c4e-46eb-ad3b-c10286f811b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050667 May 12 21:03:13.181703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 863/1752] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:13.987352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:13.987972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:13.995132 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:13.995583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:13.996389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:13.996816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:14.135749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:14.144538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-23a40fe3-0178-45ef-9027-a21b508b9e3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161132 May 12 21:03:14.145103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 890/1753] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:13 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:14.187282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:14.188239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:14.194679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:14.195127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:14.195934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:14.196638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:14.228521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-63de58c0-5739-4e3c-8abd-5aef06a39948 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045767 May 12 21:03:14.229171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 864/1754] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:15.162315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:15.162920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:15.170544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:15.171068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:15.171831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:15.172263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:15.241390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:15.242456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:15.250110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:15.250890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:15.251325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:15.251745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:15.282776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cb6de143-6a1a-4831-a87b-9454ea1ae467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045441 May 12 21:03:15.283353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 865/1755] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:15.303803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:15.312587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ade9c772-c8e8-4908-bd67-11e0b684a0e4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154151 May 12 21:03:15.313147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 891/1756] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:15.964885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:03:15.965113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:03:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:03:16.294720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:16.295780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:16.302491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:16.303020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:16.303709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:16.304196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:16.330183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:16.330895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:16.336789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b403c455-05bf-457d-b7c9-713c232d14ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046185 May 12 21:03:16.337356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 866/1757] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:16.337997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:16.338445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:16.339211 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:16.339641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:16.473859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:16.481910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8b9775eb-64da-4188-b63f-ab62a3076559 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155578 May 12 21:03:16.482472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 892/1758] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:17.349115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:17.350263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:17.356524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:17.356978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:17.359328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:17.360246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:17.389680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2c947d2c-59cf-44ee-bceb-f71935b9af08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044549 May 12 21:03:17.390302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 867/1759] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:17.499234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:17.500015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:17.506441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:17.506897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:17.507721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:17.508103 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:17.638345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:17.647086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-99dfa438-1a8f-4211-99de-9140a68d513c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151852 May 12 21:03:17.647636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 893/1760] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:17 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:18.401658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:18.402574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:18.409158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:18.409646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:18.410411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:18.410838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:18.440853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-21178907-3a19-4ebc-860b-e1d613cf0a08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043256 May 12 21:03:18.441443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 868/1761] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:18.665209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:18.665924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:18.672326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:18.673499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:18.674275 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:18.674709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:18.809863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:18.818520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2d8f3e70-374f-418a-9776-09e8c6b1323a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157217 May 12 21:03:18.819087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 894/1762] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:19.452318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:19.453242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:19.460656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:19.461109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:19.462033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:19.462474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:19.495506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2bb3157c-c4b0-44b2-bf71-26723c4a5d3a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047087 May 12 21:03:19.496074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 869/1763] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:19.836487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:19.837129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:19.843521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:19.843963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:19.844728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:19.845168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:19.978094 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:19.988395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-02d04f42-55d0-4169-a51d-81c478674c3a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155744 May 12 21:03:19.989411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 895/1764] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:20.507842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:20.508754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:20.515575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:20.516025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:20.516784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:20.517214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:20.547174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-226dc8e1-6c57-437b-9e95-150f0167421c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043209 May 12 21:03:20.547780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 870/1765] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:03:21.006806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:21.007369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:21.013735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:21.014196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:21.014960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:21.015398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:21.146735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:21.154584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91a6c720-cd11-43ce-bbf3-02dcf965758c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152480 May 12 21:03:21.155143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 896/1766] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:21 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:21.559496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:21.560435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:21.566945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:21.567395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:21.568157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:21.568618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:21.598879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9acd1693-7759-4b2e-8537-c6bdbaebcb29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043397 May 12 21:03:21.599437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 871/1767] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:22.172228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:22.172818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:22.180549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:22.181047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:22.181935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:22.182361 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:22.338499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:22.346476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2e7f569a-7fa7-4fea-ae40-8c3172047d14 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.178382 May 12 21:03:22.347038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 897/1768] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:22.610680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:22.611643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:22.618101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:22.618548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:22.619306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:22.619765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:22.652120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4b360c05-ff81-42df-bf17-ba88de130fd6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045411 May 12 21:03:22.652701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 872/1769] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:23.363766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:23.364415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:23.370903 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:23.371353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:23.372115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:23.372551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:23.500060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:23.508451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-49da13b1-d922-4fd3-bbca-eb292dd5ae46 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148819 May 12 21:03:23.509003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 898/1770] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:23 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:23.663867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:23.664792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:23.671154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:23.671603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:23.672369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:23.672805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:23.702683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0c3167c2-8611-4ea8-bb82-248f65d147d4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042720 May 12 21:03:23.703236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 873/1771] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:24.526985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:24.527647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:24.534537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:24.534985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:24.535782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:24.536214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:24.674871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:24.683520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c893b2ae-c061-4dd6-a92c-880c2bbcc502 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160339 May 12 21:03:24.683970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 899/1772] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:24 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:24.714354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:24.715274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:24.722337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:24.722717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:24.723485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:24.723923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:24.753557 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-42ae6cf4-847f-4651-8ffd-71ec4e50c060 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043101 May 12 21:03:24.754128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 874/1773] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:25.700890 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:25.701574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:25.708362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:25.708807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:25.709594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:25.710039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:25.766712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:25.767729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:25.775496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:25.776034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:25.776881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:25.777417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:25.810445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a882b5e2-f367-4df4-abfe-9011fccea802 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047750 May 12 21:03:25.814525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 875/1774] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:25.847679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:25.855653 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-69ff45e5-59ec-4e9e-80ed-ccfceb85e47f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.158607 May 12 21:03:25.856215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 900/1775] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:26.822023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:26.822955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:26.829198 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:26.829687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:26.830455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:26.830889 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:26.861611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-43d7716c-ab77-43cf-ba1c-34876b217590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043895 May 12 21:03:26.862396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 876/1776] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:03:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:03:26.873501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:26.874109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:26.880519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:26.883927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:26.883927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:26.883927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:27.015469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:27.024234 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b7e2c4c8-8425-440f-b1b9-3a635942a973 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154458 May 12 21:03:27.024728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 901/1777] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:26 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:27.873720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:03:27.874647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:27.881139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:27.882379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:27.882532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:27.882847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:27.957561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a6ba5879-6d20-40a6-815a-808faead0bcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/action" status: 200 len: 41376 microversion: 2.1 time: 0.087800 May 12 21:03:27.958223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 877/1778] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 21:03:27 2022] POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/action => generated 41376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 21:03:28.041615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:28.042228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:28.048577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.049018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.049800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.050232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.058002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:28.058789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:28.065622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.066049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.066812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.067423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.081794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 HTTP/1.1 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:03:28.084463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.086369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '31e51169-24f1-4938-b088-951b5795a799'} May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:03:28.087299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.089108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.091018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:03:28.091018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e5506478-2f9f-46f6-a3d1-5f1fdbb1623e tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 404 len: 111 microversion: 2.1 time: 0.031702 May 12 21:03:28.091018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 878/1779] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:03:28 2022] DELETE /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:03:28.094467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:28.095092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 31e51169-24f1-4938-b088-951b5795a799] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:28.108861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.108861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.108861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.108861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.119138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 HTTP/1.1 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:03:28.120377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.123747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '31e51169-24f1-4938-b088-951b5795a799'} May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:03:28.125583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. May 12 21:03:28.127658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.130512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 31e51169-24f1-4938-b088-951b5795a799 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:03:28.130512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7ff2881a-0581-4492-adbe-df437e59d82c tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799" status: 404 len: 111 microversion: 2.1 time: 0.031762 May 12 21:03:28.130512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 879/1780] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:28 2022] GET /compute/v2.1/servers/31e51169-24f1-4938-b088-951b5795a799 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:03:28.130512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:28.130925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:28.138093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.138093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.138805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.139251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.157890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d HTTP/1.1 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:03:28.159570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.162800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0592bc35-ec6e-4ccb-b2e5-39184df8c10d'} May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:03:28.163755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.165422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.168212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:03:28.168212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-182b7544-bf71-4e43-8190-152479571e7f tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 404 len: 111 microversion: 2.1 time: 0.035775 May 12 21:03:28.168212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 880/1781] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:03:28 2022] DELETE /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 21:03:28.172561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:28.173328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 0592bc35-ec6e-4ccb-b2e5-39184df8c10d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:28.179550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.180087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.180938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:28.181553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:28.199038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.199333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d HTTP/1.1 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:03:28.200591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.202342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0592bc35-ec6e-4ccb-b2e5-39184df8c10d'} May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:03:28.203296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. May 12 21:03:28.204781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:03:28.206270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 0592bc35-ec6e-4ccb-b2e5-39184df8c10d could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:03:28.206270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7f084dd3-ff25-44cd-b908-303bcf507c27 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d" status: 404 len: 111 microversion: 2.1 time: 0.034307 May 12 21:03:28.206270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 881/1782] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:28 2022] GET /compute/v2.1/servers/0592bc35-ec6e-4ccb-b2e5-39184df8c10d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:03:28.210222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4f4ba8d4-e3fe-4133-a98f-2e815a0de10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.172396 May 12 21:03:28.210902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 902/1783] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:28 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:29.227965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:29.228536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:29.235247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:29.235700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:29.236498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:29.236939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:29.536096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:29.544912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b3c1fd09-e17c-49c4-906e-327e02b7c860 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.321524 May 12 21:03:29.545499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 882/1784] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:29 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:30.567814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:30.568432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:30.575667 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:30.576115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:30.576878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:30.577332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:30.705664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:30.713544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b467eeb5-934a-4ff0-b88f-37c88f0b57e7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149465 May 12 21:03:30.714115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 903/1785] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:30 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:31.730492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:31.731108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:31.737669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:31.738122 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:31.738897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:31.739460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:31.875254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:31.883819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49f6dec9-87c5-4e62-b1f9-2098610bf7c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156589 May 12 21:03:31.884415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 883/1786] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:32.902437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:32.902972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:32.909366 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:32.909817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:32.910612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:32.911026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:33.048865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:33.057208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-50871eeb-fbe1-4de0-8790-eab19814c11c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159923 May 12 21:03:33.057794 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 904/1787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:34.075021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:34.075619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:34.081995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:34.082443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:34.083199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:34.083649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:34.216185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:34.224228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f6cb24cb-9556-4023-bb5c-4efd43ebce3c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153286 May 12 21:03:34.224799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 884/1788] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:03:35.242532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:35.243416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:35.251469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:35.251924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:35.252771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:35.253453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:35.401434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:35.410031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-63d09375-654b-4f9c-ac5d-3b67a476ca5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.171664 May 12 21:03:35.410779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 905/1789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:35 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:36.427936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:36.428555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:36.435808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:36.436260 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:36.437034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:36.437497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:36.580763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:36.589340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-472aa8de-93cc-4fe2-9eb2-3c5d73c61cb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.165384 May 12 21:03:36.589917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 885/1790] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:36 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:37.606711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:37.607975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:37.614439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:37.614894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:37.615664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:37.616097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:37.757997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:37.767017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-209ddcbf-1063-40bf-ac92-2217b890f5a1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164306 May 12 21:03:37.767585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 906/1791] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:38.784637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:38.785232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:38.794259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:38.794529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:38.795088 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:38.795524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:38.928915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:38.937869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-53fd927a-d649-4613-beb1-4884a20024ad tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157095 May 12 21:03:38.938438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 886/1792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:39.955659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:39.956228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:39.963403 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:39.964192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:39.965525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:39.966257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:40.104556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:40.112932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-26b58af5-8c8a-4e63-98f0-3103f71613b5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161212 May 12 21:03:40.113571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 907/1793] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:41.130300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:41.130899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:41.138174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:41.138614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:41.139377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:41.139817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:41.289192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:41.298369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c9080e7e-56ce-4e7a-a805-427dfea0f349 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.171715 May 12 21:03:41.298848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 887/1794] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:41 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:42.317066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:42.317819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:42.324513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:42.324964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:42.325772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:42.326213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:42.456372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:42.464952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d71dde2-ab9e-4ee7-8fe7-f45eb9ed78ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151852 May 12 21:03:42.465595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 908/1795] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:42 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:43.483457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:43.484021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:43.490345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:43.490810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:43.491578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:43.492010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:43.638584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:43.646609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3cdc37e3-650e-4d6c-92e4-91419ccacbfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.168216 May 12 21:03:43.647171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 888/1796] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:44.664681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:44.665303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:44.672309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:44.672760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:44.673559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:44.674001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:44.808290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:44.816204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-27597d8f-be4c-4692-af53-c0d1ff63d008 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155393 May 12 21:03:44.816766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 909/1797] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:45.833900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:45.834499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:45.841789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:45.842241 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:45.843059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:45.843498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:45.983177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:45.991243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-14c41ad2-22c3-4834-b41a-dec8d3ff6174 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161372 May 12 21:03:45.991831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 889/1798] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:47.009002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:47.009594 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:47.017016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:47.017502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:47.018265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:47.018696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:47.150145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:47.159013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f9e389f8-f8ad-4ee9-9633-ba7b1fe05e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154051 May 12 21:03:47.159810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 910/1799] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:47 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:48.177327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:48.177894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:48.185177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:48.185755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:48.186525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:48.186965 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:48.327798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:48.336255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d0653d81-6ac8-4663-936d-38847a17f0f3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.162771 May 12 21:03:48.336820 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 890/1800] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:49.354108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:49.354724 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:49.361942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:49.362395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:49.363161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:49.363609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:49.672960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:49.681110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-34a16279-a5d5-4764-b9ed-3cb2e8467386 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.330722 May 12 21:03:49.681695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 911/1801] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:49 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:50.698932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:50.699515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:50.706173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:50.706634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:50.707406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:50.707845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:50.838027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:50.846289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8b2b92e4-455d-4558-9e6c-088f31179e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151270 May 12 21:03:50.846872 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 891/1802] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:51.863753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:51.864378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:51.870547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:51.870999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:51.871769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:51.872206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:52.002696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:52.010908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ae0c9959-c35c-4f4a-a918-6e6ff59b8ca5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151046 May 12 21:03:52.011466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 912/1803] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:53.028287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:53.028923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:53.035887 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:53.036337 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:53.037100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:53.037565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:53.171006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:53.180176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ac0cc5a0-7c68-4498-8c84-bd982212e15f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155780 May 12 21:03:53.180748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 892/1804] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:54.198810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:54.199379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:54.206539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:54.206992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:54.207755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:54.208191 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:54.341382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:54.349456 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3398a8d0-2cd5-478b-93ec-40f05fa51158 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154784 May 12 21:03:54.350007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 913/1805] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:55.366912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:55.367534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:55.373871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:55.374316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:55.375077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:55.375506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:55.505136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:55.513085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d94450eb-c150-4aad-8052-89eb7b5ad297 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150025 May 12 21:03:55.513674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 893/1806] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:56.530640 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:56.531262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:56.537850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:56.538301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:56.539082 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:56.539518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:56.670922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:56.680124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-83adb634-d459-4f39-8900-16561a19880d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153420 May 12 21:03:56.680830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 914/1807] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:57.698793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:57.699455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:57.706187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:57.707329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:57.707471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:57.707922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:57.839659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:57.848799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d32989f1-0e5d-4b81-8c64-bc3ffbc25140 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153870 May 12 21:03:57.849406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 894/1808] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:03:58.866138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:03:58.866770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:03:58.873289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:58.873749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:58.874531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:03:58.874978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:03:59.015491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:03:59.023965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0bca9457-f06d-4587-92bd-a8f02625c41a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161683 May 12 21:03:59.024524 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 915/1809] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:03:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:00.045147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:00.046469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:00.054014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:00.054468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:00.055252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:00.055688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:00.188182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:00.196142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f3c91856-d447-4c33-84a7-1b1e669c7d6d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155377 May 12 21:04:00.196714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 895/1810] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:00 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:04:01.213190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:01.213845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:01.220013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:01.221217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:01.222009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:01.222451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:01.354768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:01.362682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6b368db1-0835-41fe-8358-387d3267a108 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153289 May 12 21:04:01.363295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 916/1811] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:02.380412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:02.381119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:02.387704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:02.388154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:02.388909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:02.389371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:02.518336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:02.526229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-61f1e0f7-9b16-4422-90aa-dea35c7312bf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150242 May 12 21:04:02.526796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 896/1812] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:03.544006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:03.544699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:03.551206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:03.552081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:03.552887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:03.553342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:03.685964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:03.694988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ee1e137a-6eed-42ef-9cc7-69a4def7acc7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155113 May 12 21:04:03.695608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 917/1813] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:03 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:04.713525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:04.714165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:04.720433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:04.720883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:04.721673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:04.722097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:04.857409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:04.866362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d54bf700-73f4-4b3a-b9ff-3c74940072eb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157172 May 12 21:04:04.866971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 897/1814] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:05.884151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:05.884851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:05.891487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:05.891941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:05.892720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:05.893165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:06.026057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:06.033874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ad08e679-3e58-472a-b871-0bbffad1ef87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154302 May 12 21:04:06.034427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 918/1815] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:07.051513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:07.052119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:07.059443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:07.059891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:07.060666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:07.061100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:07.190766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:07.199427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15f7051c-0663-4283-b415-df883a8761cb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151756 May 12 21:04:07.199997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 898/1816] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:07 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:08.216111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:08.216675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:08.222847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:08.223333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:08.224605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:08.225223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:08.354051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:08.361935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8af84a14-7741-417f-9754-e54a17a34235 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149906 May 12 21:04:08.362510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 919/1817] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:09.380523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:09.381458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:09.387970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:09.388419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:09.389180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:09.389635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:09.523582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:09.531503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a22c080a-08ed-462a-8d6e-44bc5754190f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155041 May 12 21:04:09.532128 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 899/1818] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:10.549413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:10.550010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:10.557879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:10.558359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:10.559169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:10.559610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:10.693512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:10.701847 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ddb709b0-12d8-4153-a884-bd552596ce86 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156168 May 12 21:04:10.702433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 920/1819] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:10 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:11.719901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:11.720532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:11.728536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:11.729155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:11.730510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:11.731278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:11.882891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:11.891268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2b65dacf-1748-43d8-9097-8792e35e442d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.175282 May 12 21:04:11.891910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 900/1820] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:12.907922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:12.908549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:12.915340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:12.915800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:12.916577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:12.917020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:13.049605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:13.058887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bafe4456-c0e8-48b1-86cd-c390e4fe5dcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154933 May 12 21:04:13.059455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 921/1821] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:14.077138 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:14.077789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:14.083842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:14.084289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:14.085056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:14.085518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:14.217126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:14.226020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0df84712-96dd-47af-b603-adde2ecc6242 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152853 May 12 21:04:14.226608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 901/1822] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:14 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:15.243621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:15.244188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:15.250599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:15.251049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:15.251807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:15.252308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:15.380174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:15.388982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b2051ad9-ba1e-4ed8-99f0-ca87c3cb2fbe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149635 May 12 21:04:15.389706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 922/1823] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:16.407037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:16.407656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:16.415032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:16.415501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:16.416267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:16.416703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:16.549632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:16.558663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-57d0ea2b-9faf-4c81-bdf3-c89180ccc57a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155162 May 12 21:04:16.559506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 902/1824] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:17.584638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:17.585262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:17.591932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:17.592376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:17.593139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:17.593602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:17.727100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:17.735965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6428bb62-dff3-43fa-9ca1-8227cf22932c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155240 May 12 21:04:17.736586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 923/1825] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:17 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:18.754813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:18.755453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:18.762354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:18.762810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:18.763580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:18.764019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:18.896290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:18.904206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f2eeb729-2516-4184-88d2-a6ec9bdf8db7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153554 May 12 21:04:18.904775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 903/1826] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:19.922426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:19.923068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:19.929666 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:19.930123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:19.930906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:19.931353 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:20.058982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:20.066884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-86bdeebd-2759-455c-8201-621b7879f565 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148639 May 12 21:04:20.067448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 924/1827] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:21.084022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:21.084655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:21.091736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:21.092178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:21.092937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:21.093394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:21.231514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:21.239190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e9aabc45-f1d2-40a6-b179-2b726a525f30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159041 May 12 21:04:21.239755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 904/1828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:21 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:22.258024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:22.258634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:22.266429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:22.266881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:22.267662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:22.268105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:22.407941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:22.416031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4d71bb39-9b08-4683-b143-7b5ce290a352 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.162007 May 12 21:04:22.416599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 925/1829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:23.433975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:23.434597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:23.441131 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:23.441613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:23.442379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:23.442816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:23.580978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:23.583865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5bd24d73-776f-4786-a3f7-8e95ca3b310f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153691 May 12 21:04:23.584713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 905/1830] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:23 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:24.602700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:24.603507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:24.610310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:24.610766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:24.611548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:24.611994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:24.751738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:24.759517 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5fef223e-53b3-4ceb-90ae-da9a1b824418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160857 May 12 21:04:24.760085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 926/1831] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:24 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:25.779089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:25.779707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:25.786068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:25.786666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:25.787371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:25.787791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:25.925957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:25.933764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9eb11fe9-34f0-4ee2-adf8-2571abfcfdf9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.158642 May 12 21:04:25.934326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 906/1832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:26.951981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:26.952591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:26.958975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:26.959423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:26.960184 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:26.960622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:27.087758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:27.095499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-db6bdc2d-586e-4e6e-8b33-8924a41179e2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148002 May 12 21:04:27.096060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 927/1833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:26 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:28.113524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:28.114144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:28.121363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:28.121823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:28.122807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:28.123247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:28.251904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:28.259545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af0784f4-ffa2-48ad-9d80-9d6d12809e44 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149903 May 12 21:04:28.260111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 907/1834] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:28 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:29.277591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:29.278663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:29.285315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:29.285773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:29.286529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:29.286956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:29.416313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:29.425376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dfe7ac86-8289-4e7a-90af-19fab9e1b4fd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151695 May 12 21:04:29.426042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 928/1835] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:29 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:30.442862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:30.443482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:30.449888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:30.450985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:30.451769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:30.452205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:30.687491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:30.696118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ab8d9ab4-897d-4312-8795-e17652f7bae4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.257056 May 12 21:04:30.696614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 908/1836] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:30 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:31.713644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:31.770974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:31.770974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:31.770974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:31.770974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:31.771441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:31.853931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:31.865525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3fdc35f4-66c3-40c3-bf15-43fe9b40464b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155509 May 12 21:04:31.865792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 929/1837] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:32.882497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:32.883124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:32.890396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:32.890849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:32.891621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:32.892060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:33.023466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:33.031252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9869ace6-8cbc-4049-9481-6f8198f48273 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152805 May 12 21:04:33.031808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 909/1838] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:34.048029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:34.048675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:34.055229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:34.055681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:34.056450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:34.056883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:34.188654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:34.196551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cd7e91a6-8c16-4c6e-93f5-926001c9e800 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152434 May 12 21:04:34.197341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 930/1839] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:35.215179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:35.215779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:35.223087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:35.223532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:35.224289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:35.224725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:35.355670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:35.364680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-777ec367-4907-4bc0-9216-69443657cab9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153387 May 12 21:04:35.365264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 910/1840] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:35 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:36.381843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:36.382469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:36.389338 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:36.389777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:36.390577 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:36.391016 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:36.518453 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:36.526203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-39ad8cba-b69b-4b92-aa07-423c707cc257 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148339 May 12 21:04:36.526768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 931/1841] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:36 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:04:37.543695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:37.544305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:37.551218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:37.551668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:37.552427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:37.552863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:37.687472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:37.695314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-476be30f-b777-4880-a547-aa652af60762 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155404 May 12 21:04:37.695866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 911/1842] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:38.712467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:38.713075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:38.720901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:38.721386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:38.722223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:38.722655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:38.866381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:38.881089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cfa7869b-7596-4240-94c8-63a13a4d6c68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.170057 May 12 21:04:38.881714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 932/1843] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:39.900264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:39.900882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:39.907350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:39.907805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:39.908568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:39.909043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:40.036976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:40.044832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5b6eed91-650f-43ad-be6f-19747c1d7203 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148464 May 12 21:04:40.045430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 912/1844] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:41.061942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:41.062495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:41.068687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:41.069141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:41.069952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:41.070390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:41.198733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:41.207123 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-29ef6916-1b04-4bee-991d-4b6449322c2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149199 May 12 21:04:41.207686 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 933/1845] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:41 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:42.223958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:42.224575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:42.230971 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:42.231421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:42.232802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:42.233254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:42.366985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:42.375195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2924fc89-a147-45a7-b2e8-b298793e6161 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155111 May 12 21:04:42.375758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 913/1846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:42 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:43.393063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:43.393627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:43.399795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:43.400247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:43.401023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:43.401490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:43.528474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:43.537036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2e96f6f9-5d42-47de-b665-b155025e5a58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148456 May 12 21:04:43.537636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 934/1847] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:44.555136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:44.556093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:44.564779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:44.565220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:44.566011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:44.566443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:44.695413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:44.703768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ee24b9b1-521d-4448-9824-57638bfba06f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152961 May 12 21:04:44.704336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 914/1848] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:45.721357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:45.722093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:45.729035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:45.729514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:45.730279 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:45.730709 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:45.880798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:45.889819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-41b5f28c-a1ab-416f-9925-46bee47d4bcf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.172331 May 12 21:04:45.890385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 935/1849] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:46.906764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:46.907311 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:46.913800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:46.914253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:46.915021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:46.915456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:47.045153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:47.053248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-98f6a0a2-5a78-46e3-8ec2-c918c08ab90f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150571 May 12 21:04:47.053865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 915/1850] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:47.410731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:04:47.411321 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:04:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:04:48.071167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:48.071784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:48.079339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:48.079806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:48.080566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:48.080996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:48.216756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:48.224581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b614a31d-36be-4cb3-912d-cf684ca5852a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157227 May 12 21:04:48.225134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 936/1851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:49.243145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:49.243767 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:49.250339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:49.250792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:49.251566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:49.252005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:49.386433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:49.394720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df26416a-63a0-47f5-8b45-3d481700cd94 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157599 May 12 21:04:49.395282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 916/1852] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:49 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:50.411964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:50.412573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:50.418445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:50.418891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:50.420797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:50.421242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:50.549949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:50.557663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-df2d90aa-46db-4254-a5b5-b3585bcb63f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149623 May 12 21:04:50.558226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 937/1853] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:51.574861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:51.575959 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:51.582511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:51.582961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:51.583730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:51.584168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:51.713235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:51.722204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bc34d104-91ed-45b6-a852-553f3a6f1658 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151352 May 12 21:04:51.722777 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 917/1854] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:04:52.387020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:04:52.387212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:04:52.739169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:52.739737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:52.745998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:52.746444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:52.747199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:52.748124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:52.875672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:52.883298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-19ffa29a-9159-4fff-a90a-4e1dadef5ff7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148191 May 12 21:04:52.883852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 938/1855] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:52 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:53.901663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:53.902274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:53.909215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:53.909691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:53.910454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:53.910890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:54.202690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:54.210442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8c8aaf30-b36c-41b6-b202-ab87adeadbf6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.312752 May 12 21:04:54.210996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 918/1856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:55.228091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:55.228654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:55.235510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:55.235961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:55.236727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:55.237163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:55.368088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:55.376023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b40d39d0-7ee0-4505-ac0b-c8759c597d4f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151921 May 12 21:04:55.376584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 939/1857] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:56.393004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:56.393654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:56.399939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:56.400394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:56.401156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:56.401628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:56.532335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:56.545498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-675a9ad6-9102-4802-9e18-f536517df0bc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156229 May 12 21:04:56.546051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 919/1858] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:57.563487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:57.564091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:57.570462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:57.570912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:57.571704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:57.572142 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:57.709626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:57.718174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9d5c75bf-9958-434e-a302-2deded7211aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159301 May 12 21:04:57.718528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 940/1859] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:58.735066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:58.735675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:58.741998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:58.742445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:58.743209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:58.743643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:58.877652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:04:58.885416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-efa40cb8-8397-40ea-9ce9-4b2b241f92a4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154224 May 12 21:04:58.885976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 920/1860] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:04:59.903636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:04:59.904420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:04:59.910853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:59.911310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:04:59.912129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:04:59.912575 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:00.042882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:00.050836 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-40094804-11cf-4673-9465-e4593de283aa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151102 May 12 21:05:00.051395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 941/1861] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:04:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:01.067921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:01.068540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:01.074892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:01.075918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:01.076696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:01.077136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:01.208342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:01.217093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fd9c8208-95a8-48e0-943a-9c7dc674f4d7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152956 May 12 21:05:01.217679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 921/1862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:02.234267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:02.234906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:02.241381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:02.241905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:02.242672 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:02.243108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:02.372729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:02.380519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-972aec53-9081-4b57-a633-1d506aa770f0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150210 May 12 21:05:02.381098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 942/1863] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:03.399378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:03.400005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:03.407523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:03.407977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:03.408760 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:03.409205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:03.539305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:03.547383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f9537cc4-4b89-4ad2-a0fc-3f27e554f91a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152079 May 12 21:05:03.547942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 922/1864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:03 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:04.564536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:04.565112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:04.572784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:04.573290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:04.574193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:04.574636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:04.703765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:04.711506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-21dec394-e51e-4525-90ba-4d2ce2f9dc2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151052 May 12 21:05:04.712066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 943/1865] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:05.730041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:05.730731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:05.737223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:05.737816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:05.738496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:05.738931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:05.873743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:05.881535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ae2277f7-3761-4c69-bd59-4a66037b6aef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155421 May 12 21:05:05.882092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 923/1866] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:06.899510 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:06.900124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:06.907231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:06.907684 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:06.908447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:06.908887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:07.040695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:07.049579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f232d7c5-f42c-440f-aa89-f1328391090e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153888 May 12 21:05:07.050138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 944/1867] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:06 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:08.066970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:08.067559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:08.073857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:08.074312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:08.075839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:08.076378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:08.204290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:08.212080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-10053c81-0144-4f7f-9684-2896184c9add tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148919 May 12 21:05:08.212643 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 924/1868] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:09.230059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:09.230642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:09.237974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:09.238427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:09.239197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:09.239639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:09.375820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:09.383790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e3a82be0-5bdc-428c-87ce-c11057ed1359 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157693 May 12 21:05:09.384352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 945/1869] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:10.401819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:10.402446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:10.409740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:10.410196 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:10.410968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:10.411607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:10.546892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:10.555045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6efa4b29-0596-495f-862e-1b2bed5a3ce7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157553 May 12 21:05:10.564967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 925/1870] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:10 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:10.739821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:05:10.740602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:05:11.571986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:11.572600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:11.579005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:11.579444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:11.580203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:11.580643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:11.715190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:11.723333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-439a1159-8f21-48dc-a5a9-3ab68db98328 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155190 May 12 21:05:11.723913 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 946/1871] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:12.740629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:12.741305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:12.748104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:12.748564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:12.749383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:12.749842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:12.882005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:12.890200 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ba9af2b1-3395-4328-8854-e37ca064bc60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153409 May 12 21:05:12.890793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 926/1872] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:13.908025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:13.908658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:13.914932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:13.915384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:13.916177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:13.916691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:14.061877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:14.070552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2f2e3e69-c153-482d-a6ca-c207a8d62849 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.166688 May 12 21:05:14.071110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 947/1873] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:13 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:15.088055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:15.088644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:15.095533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:15.095985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:15.096773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:15.097206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:15.229238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:15.237842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bf77ac99-5472-42fb-9987-1ed1d09974c4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153978 May 12 21:05:15.238409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 927/1874] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:16.255470 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:16.256072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:16.262873 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:16.263326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:16.264101 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:16.264539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:16.394566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:16.402336 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-808f40e5-3b12-4d13-88fe-02504753fc24 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150764 May 12 21:05:16.402895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 948/1875] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:05:17.419973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:17.420729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:17.427552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:17.427998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:17.428761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:17.429195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:17.561107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:17.569406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1d71294c-3720-481b-b4ab-4533f1d2c970 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153185 May 12 21:05:17.569973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 928/1876] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:17 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:18.587393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:18.588037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:18.594578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:18.595034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:18.595804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:18.596244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:18.730160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:18.738605 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f546e809-3d0b-4e4a-9492-cda9b7074f2a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155023 May 12 21:05:18.739264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 949/1877] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:19.757421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:19.758033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:19.764925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:19.765465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:19.766739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:19.766739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:19.898406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:19.906191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9fa68165-0f1c-46a6-a7ff-3c6bbb026fbd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152845 May 12 21:05:19.906750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 929/1878] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:20.923602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:20.924305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:20.930303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:20.930757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:20.931538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:20.931980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:21.057717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:21.067398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dd1cca78-f7c8-4ba9-a456-51e4746a59c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148084 May 12 21:05:21.068589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 950/1879] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:20 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:22.087456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:22.088074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:22.095042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:22.095485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:22.096242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:22.096701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:22.228505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:22.236265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d5527b87-78a0-4af9-bad3-39161173fc82 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152704 May 12 21:05:22.236822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 930/1880] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:23.252990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:23.253641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:23.259893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:23.260349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:23.261424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:23.261861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:23.394569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:23.402546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6449a3de-5fde-4a75-aca6-5405971105e1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153619 May 12 21:05:23.403696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 951/1881] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:23 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:24.421895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:24.422736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:24.428711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:24.429163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:24.429966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:24.430419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:24.569998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:24.578625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5e37c125-1dc0-4fc5-a651-034916951dc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160204 May 12 21:05:24.579262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 931/1882] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:24 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:25.596459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:25.597085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:25.603586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:25.604042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:25.604830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:25.605309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:25.737430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:25.745239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4fcb32e0-f006-47db-a22b-278f9daf816e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153613 May 12 21:05:25.745832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 952/1883] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:26.762539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:26.763283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:26.769829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:26.770279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:26.771039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:26.771472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:26.906307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:26.915120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4f6bd85d-b3e1-4a7a-887c-8eef6b490426 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156681 May 12 21:05:26.915682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 932/1884] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:26 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:27.932795 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:27.933423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:27.940565 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:27.941013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:27.941823 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:27.942262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:28.068549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:28.078133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4b1c3105-1f35-4948-a0ed-1643deb345b6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149285 May 12 21:05:28.078845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 953/1885] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:27 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:29.095092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:29.095829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:29.103140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:29.103590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:29.104372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:29.104808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:29.242775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:29.250721 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-be6394f3-bf41-413a-82f8-18b2aaa1206f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159582 May 12 21:05:29.251276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 933/1886] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:29 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:30.267750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:30.268480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:30.275619 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:30.276091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:30.276898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:30.277382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:30.410733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:30.418582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7939e0d2-0575-4665-8e6b-00f294a585a0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154861 May 12 21:05:30.419138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 954/1887] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:30 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:31.436448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:31.437089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:31.444336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:31.444791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:31.445592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:31.446033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:31.579077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:31.586476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fad0f207-c59b-4050-9187-6b4662e4183c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153961 May 12 21:05:31.587038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 934/1888] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:32.604091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:32.604712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:32.611858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:32.612436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:32.613216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:32.613693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:32.741874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:32.750003 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-766c4a4d-06e2-4901-896a-65c2dbbdbc23 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149735 May 12 21:05:32.750593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 955/1889] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:33.767094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:33.767756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:33.774123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:33.774576 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:33.775345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:33.775784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:33.904332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:33.912386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-782f2c6b-bb13-4fcb-bf2e-3730b04faa4e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149173 May 12 21:05:33.912953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 935/1890] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:33 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:34.930299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:34.930920 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:34.937295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:34.937773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:34.938551 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:34.938993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:35.066326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:35.074197 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-19fa62cd-9f5c-4ede-b636-feba66039b60 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.147678 May 12 21:05:35.074758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 956/1891] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:36.092295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:36.092939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:36.101204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:36.101719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:36.102537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:36.102979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:36.245302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:36.259524 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dc08ec49-026d-42c7-ad29-d64358afea55 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.171101 May 12 21:05:36.260107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 936/1892] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:36 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:37.277652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:37.278383 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:37.284865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:37.285348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:37.286157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:37.286598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:37.422632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:37.431232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-785a0148-9184-4585-acf2-26c546d7e886 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157532 May 12 21:05:37.431798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 957/1893] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:38.449511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:38.450144 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:38.457179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:38.457673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:38.458458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:38.458899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:38.603857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:38.612332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eaedd157-4403-4803-858d-86b1c823e7ee tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.166650 May 12 21:05:38.612901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 937/1894] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:39.629843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:39.630429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:39.637436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:39.637892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:39.638697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:39.639156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:39.770068 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:39.777909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-757fc531-cd2c-424d-a9a1-8781c0c49ea7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152060 May 12 21:05:39.778475 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 958/1895] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:40.796254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:40.796952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:40.804607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:40.805068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:40.805881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:40.806323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:40.935017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:40.943980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b132aed0-6ba6-4867-8a4b-99d75a3c8668 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151679 May 12 21:05:40.944548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 938/1896] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:40 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:41.960663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:41.961314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:41.967817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:41.968274 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:41.969055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:41.969522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:42.104976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:42.119079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-47734ec0-18f5-4c6e-b613-24b38d3ca79f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.162236 May 12 21:05:42.119572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 959/1897] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:41 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:43.145749 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:43.146364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:43.152304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:43.152748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:43.153556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:43.153986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:43.295917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:43.304608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8a99c906-0b34-40a4-837e-f966b0cc0aac tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164026 May 12 21:05:43.305173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 939/1898] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:44.321832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:44.322457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:44.328834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:44.329348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:44.330379 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:44.330835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:44.458319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:44.465979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-edeb305c-1fc9-42e9-807f-4b8bc2a4333c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148107 May 12 21:05:44.466530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 960/1899] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:45.484398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:45.485037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:45.492262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:45.492717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:45.493552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:45.493991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:45.621027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:45.630191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-63de588c-f8e9-4e2a-ac67-730975ad7742 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149811 May 12 21:05:45.630768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 940/1900] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:46.647800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:46.648419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:46.654875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:46.655344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:46.656115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:46.656553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:46.785819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:46.793569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-45d4e623-6f6e-4d9c-b870-5a4f2b51cfa9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149719 May 12 21:05:46.794131 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 961/1901] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:47.811551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:47.812205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:47.818900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:47.819355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:47.820142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:47.820594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:47.950853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:47.958984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfd39231-7baa-4e59-ab82-bd1cb6efcc3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151327 May 12 21:05:47.959555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 941/1902] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:47 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:48.976670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:48.977303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:48.983722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:48.984179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:48.984975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:48.986088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:49.116992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:49.125020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4fc33d0d-ff53-4232-b0df-4e457545d96c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151985 May 12 21:05:49.125373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 962/1903] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:50.146091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:50.146091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:50.150318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:50.150891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:50.151966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:50.152530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:50.286394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:50.294145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-67cae965-399c-4b93-adda-af2f6bf2e5c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155227 May 12 21:05:50.294703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 942/1904] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:51.311658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:51.312264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:51.318848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:51.319299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:51.320058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:51.320495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:51.447428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:51.457048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-51680647-ab61-4a6c-bc30-4a644cb93457 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148188 May 12 21:05:51.457629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 963/1905] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:52.474175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:52.474747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:52.481074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:52.481551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:52.482323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:52.482788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:52.612132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:52.619904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70274e4f-6b95-4887-9121-adac92ef9f8e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150380 May 12 21:05:52.620490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 943/1906] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:52 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:53.637315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:53.637908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:53.645367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:53.645817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:53.646573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:53.647006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:53.776792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:53.785433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0244d701-264f-42af-ace8-8b2bda40f693 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152267 May 12 21:05:53.785993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 964/1907] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:54.804428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:54.804966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:54.811448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:54.811879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:54.812640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:54.813072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:54.949580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:54.957596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ec70a1ff-f62d-408f-be4e-9eb8806e2c65 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157069 May 12 21:05:54.958164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 944/1908] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:55.975542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:55.976146 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:55.982648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:55.983105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:55.983876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:55.984315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:56.113443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:56.121180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8ee15c25-5702-45aa-b0f2-6bdc8937c6be tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149555 May 12 21:05:56.121701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 965/1909] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:05:57.138807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:57.139411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:57.145914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:57.146364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:57.147151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:57.147589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:57.279553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:57.288341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0588d2d2-a77c-4d2f-a323-0f4a29dcc84c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153745 May 12 21:05:57.288912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 945/1910] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:58.306031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:58.306627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:58.312909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:58.313387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:58.314250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:58.314942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:58.444655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:58.452405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1d66dc8b-e64c-4fce-b72f-074cc83a07f1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150276 May 12 21:05:58.452960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 966/1911] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:05:59.470623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:05:59.471398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:05:59.477595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:59.478930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:59.478930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:05:59.479242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:05:59.616455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:05:59.621964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a5ea38ac-f825-4b12-832b-be67dbffad6f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155404 May 12 21:05:59.622637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 946/1912] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:05:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:06:00.640244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:00.640837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:00.648519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:00.648970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:00.649769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:00.650204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:00.779581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:00.788236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-412bb981-c776-44a6-a35b-402450119dc3 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152169 May 12 21:06:00.788812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 967/1913] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:00 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:01.811021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:01.811637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:01.818679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:01.819133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:01.819900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:01.820341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:01.956969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:01.964731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-95355564-a299-45c1-afd5-7a754d6a22f8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.157613 May 12 21:06:01.965330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 947/1914] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:02.982542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:02.983532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:02.990590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:02.991038 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:02.991812 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:02.992240 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:03.119993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:03.127600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c4b349ca-5534-4849-aa76-35a690460ac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149112 May 12 21:06:03.128958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 968/1915] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:04.146658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:04.147215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:04.153523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:04.153979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:04.154754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:04.155193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:04.285845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:04.293567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f2f50db1-c67e-4af7-8bac-ae4aa2777142 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151577 May 12 21:06:04.294137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 948/1916] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:05.310822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:05.311457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:05.318880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:05.319325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:05.320081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:05.320514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:05.449500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:05.457295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b935e06c-b26a-466a-a78a-66133bd15952 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150369 May 12 21:06:05.457855 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 969/1917] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:06.474944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:06.475529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:06.481792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:06.482236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:06.482999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:06.483433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:06.616702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:06.624638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4ba19ff-1936-41e4-9be8-936c7217a0f7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154233 May 12 21:06:06.625204 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 949/1918] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:06 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:07.642423 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:07.643052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:07.650112 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:07.650560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:07.651322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:07.651760 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:07.777454 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:07.786081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cd5c6358-c705-4cb3-a699-f65d68833af4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.147470 May 12 21:06:07.786657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 970/1919] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:07 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:08.803734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:08.804319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:08.810607 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:08.811063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:08.811881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:08.812301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:08.942934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:08.950728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d3a61cb8-dab3-4f1c-a926-5444c977f825 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151533 May 12 21:06:08.951290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 950/1920] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:09.968039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:09.968646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:09.976255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:09.976701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:09.977498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:09.977952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:10.106676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:10.115050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e7d2434-1ed5-4456-973d-a7c8f98793a5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150831 May 12 21:06:10.115694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 971/1921] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:11.132825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:11.133425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:11.139888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:11.140343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:11.141233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:11.141845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:11.271294 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:11.279102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ee730b18-a1ff-4321-8e5f-edd547414f7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150326 May 12 21:06:11.279660 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 951/1922] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:12.300035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:12.300925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:12.306870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:12.307319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:12.308074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:12.308508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:12.435039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:12.442975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-16190be3-ffc3-4639-a163-265393f88337 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.147519 May 12 21:06:12.443542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 972/1923] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:13.460756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:13.461332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:13.467345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:13.467787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:13.468547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:13.468989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:13.595522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:13.604731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bd62a374-8173-4c54-875f-24a7a8f27acc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148082 May 12 21:06:13.605350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 952/1924] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:13 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:14.622592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:14.623208 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:14.630273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:14.630720 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:14.631469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:14.631904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:14.770250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:14.778409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-349eb709-6177-417b-a1f2-ded9d5ed4bc5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159659 May 12 21:06:14.778968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 973/1925] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:14 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:15.797330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:15.797946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:15.805058 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:15.805541 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:15.806457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:15.806952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:15.946341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:15.954114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-14b3892a-e8f0-4321-a3aa-2d51a06faa77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161982 May 12 21:06:15.954687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 953/1926] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:16.972627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:16.973508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:16.979615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:16.980089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:16.980850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:16.981310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:17.108591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:17.117076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e17078bf-bb8c-44a3-a1ba-209509da5b3b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148786 May 12 21:06:17.117673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 974/1927] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:18.134520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:18.135134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:18.141832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:18.142278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:18.143049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:18.143485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:18.274325 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:18.282049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ea19a500-afa1-4c64-b699-6de18454cb16 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151436 May 12 21:06:18.282603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 954/1928] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:19.299332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:19.299869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:19.306244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:19.306705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:19.307472 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:19.307912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:19.436067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:19.444980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-36b1776c-aa7c-4243-9b17-238ae0c3d2d4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149751 May 12 21:06:19.445569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 975/1929] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:20.462860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:20.463421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:20.470238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:20.470689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:20.471466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:20.471907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:20.598964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:20.606852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-48ffc038-08d4-4462-bd7e-61e548700b0b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148004 May 12 21:06:20.607412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 955/1930] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:20 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:21.543598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:06:21.544312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:06:21.623931 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:21.624542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:21.631500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:21.631943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:21.632697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:21.633133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:21.764375 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:21.772268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-45c018d7-318c-4a8d-9dc7-be35462b75e5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152228 May 12 21:06:21.772828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 976/1931] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:21 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:22.790593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:22.791214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:22.797605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:22.798055 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:22.798821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:22.799282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:22.933787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:22.941698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7cc0bcff-bb3a-49c0-8558-814883f5fe52 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154932 May 12 21:06:22.942266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 956/1932] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:23.958800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:23.959409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:23.965837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:23.966287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:23.967045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:23.967479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:24.093303 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:24.101705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-617645d8-c2cc-4630-a5dc-518d1f58bdaf tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.146779 May 12 21:06:24.106645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 977/1933] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:23 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:25.119378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:25.119990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:25.126554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:25.127004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:25.127803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:25.128240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:25.605115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:25.612791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a0f2cad1-7018-4481-85e2-62f7e9d661c7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.497281 May 12 21:06:25.614026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 957/1934] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:26.630343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:26.630953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:26.637538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:26.637986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:26.638748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:26.639178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:26.782102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:26.790100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-82f0c729-4e71-4e31-8ad6-a01ba543170a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164266 May 12 21:06:26.790663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 978/1935] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:26 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:27.807799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:27.808374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:27.814790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:27.815250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:27.816021 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:27.817067 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:27.945353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:27.953127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0f643017-53d5-4309-9a64-6c4f9dd4b93c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149293 May 12 21:06:27.953848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 958/1936] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:27 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:28.970412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:28.971050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:28.977792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:28.978244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:28.979010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:28.979449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:29.108352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:29.117027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-424ea638-1971-460f-b95f-17b72ee30ae5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150386 May 12 21:06:29.117544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 979/1937] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:28 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:30.133998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:30.134674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:30.141779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:30.142234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:30.143045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:30.143481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:30.270528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:30.278286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0329d983-1253-45ed-b999-0d601d47ab3e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148214 May 12 21:06:30.278955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 959/1938] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:30 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:31.295924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:31.296542 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:31.303636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:31.304093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:31.304875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:31.305343 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:31.438324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:31.447236 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b4735717-7b64-4ec7-9531-b4c277fa9388 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155241 May 12 21:06:31.447808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 980/1939] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:32.465024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:32.465629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:32.472107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:32.473152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:32.473981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:32.474421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:32.609393 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:32.617523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-78685870-4ba8-46a0-ae72-725f9a6f1a26 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156468 May 12 21:06:32.618098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 960/1940] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:33.635297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:33.635905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:33.642508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:33.642962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:33.643730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:33.644714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:33.773624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:33.781345 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-72097290-ff81-4174-a094-865d8e5ebe5c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149903 May 12 21:06:33.781898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 981/1941] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:33 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:34.799490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:34.800118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:34.806810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:34.807282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:34.808039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:34.808476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:34.948118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:34.955825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-711e6d62-f8a8-45f9-90e0-cfa00a4e3618 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160292 May 12 21:06:34.956380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 961/1942] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:35.973564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:35.974209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:35.984549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Traceback (most recent call last): May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: timer() May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: cb(*args, **kw) May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: waiter.switch() May 12 21:06:35.984721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: greenlet.error: cannot switch to a different thread May 12 21:06:35.989414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:35.989868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:35.990669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:35.991109 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:36.123897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:36.140893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e8c59436-9f37-4521-8f2c-09d36c844357 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.171826 May 12 21:06:36.141502 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 982/1943] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:35 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:37.158833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:37.160786 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:37.167265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:37.167719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:37.168563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:37.169004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:37.307111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:37.314944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-be1cea08-54fe-4cd6-8d4d-590c1efe6965 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159966 May 12 21:06:37.315501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 962/1944] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:38.332297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:38.333187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:38.339598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:38.340059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:38.340844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:38.341315 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:38.470963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:38.479213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-12d509b9-8cd6-483f-a2d5-c360e6d96d22 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150958 May 12 21:06:38.479777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 983/1945] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:39.498113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:39.498669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:39.505682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:39.506084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:39.506860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:39.507303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:39.636710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:39.644596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5802a6b3-7945-4d1b-a661-2af8f79fd10a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150438 May 12 21:06:39.645195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 963/1946] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:40.662790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:40.663334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:40.669674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:40.670135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:40.670909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:40.671348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:40.810493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:40.818927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e1ddd304-aa63-49f3-a274-4fdfdb1a521a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160763 May 12 21:06:40.819492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 984/1947] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:40 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:41.626331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:06:41.626331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:06:41.837647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:41.838264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:41.844830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:41.845443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:41.846266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:41.846706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:41.985375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:41.993698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4dd7456f-2614-42ce-b478-4406717522fa tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160910 May 12 21:06:41.994262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 964/1948] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:41 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:43.011932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:43.012544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:43.019265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:43.019714 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:43.020490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:43.020923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:43.151313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:43.159193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bf74efd3-6929-403f-8dfb-6663c1ea8069 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151460 May 12 21:06:43.160266 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 985/1949] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:44.176815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:44.177480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:44.183466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:44.183922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:44.184715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:44.185155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:44.312521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:44.321762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-29d6d58e-3a1d-49cb-b87c-2cabe6fd6692 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149060 May 12 21:06:44.322323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 965/1950] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:45.339821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:45.340436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:45.346902 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:45.347347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:45.348280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:45.348721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:45.477730 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:45.485529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e318e6a6-236b-4cc2-9a1b-5db322fdad63 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149581 May 12 21:06:45.486090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 986/1951] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:46.503602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:46.504210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:46.510583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:46.511291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:46.512075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:46.512517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:46.650780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:46.658630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-61c85d36-f0ef-4f7a-8de2-cfd78af62895 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.159058 May 12 21:06:46.659272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 966/1952] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:47.676009 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:47.676624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:47.682963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:47.683415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:47.684192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:47.684615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:47.811767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:47.821304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b4374e9c-0eed-44a8-bf7b-d8ae6bffe405 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149154 May 12 21:06:47.821891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 987/1953] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:47 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:48.837699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:48.838339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:48.844605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:48.845057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:48.845843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:48.846288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:48.983739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:48.992690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7ff33582-eaa6-43c9-ac40-e99e9e12b97f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.158813 May 12 21:06:48.993351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 967/1954] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:50.009790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:50.010410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:50.025519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:50.025519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:50.025519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:50.025519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:50.151910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:50.160798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4890ec14-7208-418c-82bc-8d8380a663b4 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154873 May 12 21:06:50.161386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 988/1955] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:51.178026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:51.178668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:51.185010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:51.185500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:51.186279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:51.186711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:51.314714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:51.322519 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f958db90-6092-4ec6-a925-b7dd7f753402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149275 May 12 21:06:51.323077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 968/1956] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:52.339571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:52.340201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:52.346563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:52.347014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:52.348500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:52.349091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:52.474729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:52.482548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91276759-e9f7-449f-9d29-adbe63f8fac7 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.146778 May 12 21:06:52.483111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 989/1957] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:52 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:53.499838 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:53.500420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:53.507074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:53.507521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:53.508290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:53.508727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:53.639538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:53.647661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4d563219-97a3-4642-909f-f2a79c362172 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151787 May 12 21:06:53.648217 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 969/1958] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:54.664086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:54.665401 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:54.671793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:54.672249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:54.673027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:54.673503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:54.802971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:54.811074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9350701c-df8c-4542-bf87-a860fa6ecf79 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150872 May 12 21:06:54.811654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 990/1959] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:55.828782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:55.829425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:55.836934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:55.837425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:55.838373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:55.838847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:55.977702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:55.985464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cffc3a8a-7787-4581-adb2-d0c8bcc4d329 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.160476 May 12 21:06:55.986038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 970/1960] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:57.003115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:57.004420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:57.011464 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:57.011912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:57.012671 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:57.013107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:57.141106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:57.149363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5b04518f-28bb-469e-8eb6-8a5a42d34418 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150098 May 12 21:06:57.149947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 991/1961] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:58.166550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:58.167193 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:58.173559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:58.174015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:58.174781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:58.175223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:58.302906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:58.310753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7a00dc8a-6317-4fca-a76d-ef38c67dbfb2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.148125 May 12 21:06:58.311321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 971/1962] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:06:59.328570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:06:59.329113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:06:59.336074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:59.336528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:59.337324 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:06:59.337786 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:06:59.463584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:06:59.471530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5298cdeb-3679-4b85-b291-7ea86e61b9e0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.147003 May 12 21:06:59.472090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 992/1963] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:06:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:00.489125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:00.489725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:00.496084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:00.496535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:00.497336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:00.497784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:00.646906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:00.654928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d4a07b12-cd83-4b01-aa81-2451849def0e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.169952 May 12 21:07:00.655482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 972/1964] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:00 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:01.672687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:01.673313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:01.681049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:01.681533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:01.682304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:01.682738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:01.817206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:01.825129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-59acb3a5-c018-4b8e-8981-437c7c4d5450 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.156292 May 12 21:07:01.825725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 993/1965] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:02.842365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:02.842977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:02.850551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:02.850999 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:02.851765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:02.852195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:02.982222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:02.990464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c361afc5-a457-4412-9140-2de82a9d2b7b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151843 May 12 21:07:02.991026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 973/1966] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:04.013268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:04.013916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:04.020376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:04.020832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:04.021642 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:04.022087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:04.154027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:04.163107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cc7cb159-6e6d-40c3-9b8c-1426f00f9bfb tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153955 May 12 21:07:04.163687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 994/1967] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:05.180444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:05.180988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:05.187284 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:05.187734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:05.188528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:05.188969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:05.321807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:05.329613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-38d37fa6-75da-4f9c-9227-27ddbc7fbe09 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153104 May 12 21:07:05.330185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 974/1968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:06.348656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:06.349256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:06.355598 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:06.356052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:06.356818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:06.357255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:06.486165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:06.494285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-549a6cf7-2d1a-431f-bc82-e4010ad93c30 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150258 May 12 21:07:06.494858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 995/1969] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:06 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:07.512667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:07.513244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:07.523079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:07.523531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:07.524307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:07.524742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:07.652356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:07.660679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15facc24-4b60-4a29-8dda-e8e6355be369 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153322 May 12 21:07:07.661246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 975/1970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:07 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:08.678938 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:08.679623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:08.694108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:08.694556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:08.695317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:08.695753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:08.821556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:08.829264 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-20c11d7c-5dd1-4413-91f8-cd396e7eb703 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155227 May 12 21:07:08.829851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 996/1971] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:09.847390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:09.848201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:09.854790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:09.855267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:09.856045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:09.856540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:09.994492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:10.002183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bdfe4d07-f0b6-461d-a104-ce65d9a36f9d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.158965 May 12 21:07:10.002740 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 976/1972] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:11.019816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:11.020436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:11.026802 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:11.027261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:11.028036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:11.028479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:11.158697 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:11.167028 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4111b294-6b0b-46b0-aaef-6739961b39c8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151291 May 12 21:07:11.167658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 997/1973] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:12.185341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:12.185950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:12.192836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:12.193295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:12.194056 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:12.194490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:12.321202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:12.329172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6e7e0a7b-b1bb-4141-b686-f0a08fa4c898 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.147714 May 12 21:07:12.329766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 977/1974] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:13.347434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:13.348048 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:13.354555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:13.355035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:13.355798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:13.356237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:13.484806 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:13.493332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-93eec2c0-1c12-42c2-9136-bb65f93ba24f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.149882 May 12 21:07:13.493906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 998/1975] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:13 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:14.510261 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:14.510888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:14.516966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:14.517454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:14.518232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:14.519331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:14.650425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:14.658637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c08ba106-e046-4a70-a9b7-0804efe8ba41 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152079 May 12 21:07:14.659374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 978/1976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:14 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:15.676058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:15.676771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:15.682929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:15.683372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:15.684127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:15.684560 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:15.813907 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:15.822435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6a2db415-1d34-499b-a6e9-4b45383b37f2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150306 May 12 21:07:15.826827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 999/1977] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:16.842936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:16.843589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:16.850456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:16.850907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:16.851672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:16.852118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:16.984940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:16.993724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-01adaf4c-1699-4fac-bae8-7cdac840470d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.154679 May 12 21:07:16.994282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 979/1978] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:18.012228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:18.012776 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:18.019154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:18.019608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:18.020368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:18.020800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:18.413835 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:18.421670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-167db1fd-0322-4bc0-9b7d-50911519ccfe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.413716 May 12 21:07:18.422242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1000/1979] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:19.439611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:19.440295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:19.447682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:19.448340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:19.449084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:19.449543 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:19.583761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:19.591523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f8d250c-8053-41d1-9396-9bb66ea0eefe tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.155798 May 12 21:07:19.592084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 980/1980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:20.609249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:20.609865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:20.615983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:20.616429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:20.617189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:20.617648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:20.747596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:20.755933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46247902-71dc-45ce-abc9-923b3ef8cc70 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.150515 May 12 21:07:20.756498 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1001/1981] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:20 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:21.772703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:21.773386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:21.779692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:21.780150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:21.780927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:21.781401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:21.913043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:21.920861 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0a32e4ae-95cc-4e15-8aa4-1e6497db54e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152549 May 12 21:07:21.921589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 981/1982] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:21 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:22.938262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:22.938878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:22.945390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:22.945844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:22.946617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:22.947050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:23.076799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:23.085994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5c0a3611-8e07-422c-b7f1-d390b4719a01 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.151665 May 12 21:07:23.086561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1002/1983] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:24.103885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:24.104513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:24.111326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:24.111784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:24.114798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:24.114798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:24.255285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:24.263916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-476b9b5d-4105-4b33-8e05-6e5f48e2e009 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.164205 May 12 21:07:24.264500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 982/1984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:24 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:25.281675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:25.282293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:25.289457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:25.289919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:25.290694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:25.291137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:25.414961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:25.422698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3e8b74b4-41c0-4b5c-8807-ee24f91ce1c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.145007 May 12 21:07:25.423263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1003/1985] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:26.439143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:26.439765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:26.446203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:26.446662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:26.447474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:26.447917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:26.580993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:26.588930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c3b5130f-84c7-407f-8d31-a90fea0b2e58 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.153652 May 12 21:07:26.589522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 983/1986] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:26 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:27.607229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:27.607976 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:27.615765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:27.616220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:27.616998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:27.617473 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:27.746824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:27.755173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-68f88841-cc8c-48c0-ac1f-d08d038573c9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.152145 May 12 21:07:27.755731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1004/1987] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:27 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:28.772761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:28.773363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:28.783002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:28.784334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:28.785739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:28.786550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:28.921015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:28.930120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6e4b9505-1a8c-4f6c-9033-b6ba3e477733 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1559 microversion: 2.1 time: 0.161879 May 12 21:07:28.930676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 984/1988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:28 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:29.695046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [req-f351c709-2bc1-4098-8976-3ba3109cd8ec req-959bad25-a0fc-49cf-8b7e-d639e6666094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ab3d9c-d609-4b71-98bf-2b56f872645d", "name": "network-vif-deleted", "tag": "ead1f063-0b06-48b1-bb92-fb802fd50e6a"}]} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:07:29.702895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-f351c709-2bc1-4098-8976-3ba3109cd8ec req-959bad25-a0fc-49cf-8b7e-d639e6666094 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:29.703341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [req-f351c709-2bc1-4098-8976-3ba3109cd8ec req-959bad25-a0fc-49cf-8b7e-d639e6666094 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:29.714595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.compute.server_external_events [req-f351c709-2bc1-4098-8976-3ba3109cd8ec req-959bad25-a0fc-49cf-8b7e-d639e6666094 service nova] Creating event network-vif-deleted:ead1f063-0b06-48b1-bb92-fb802fd50e6a for instance 10ab3d9c-d609-4b71-98bf-2b56f872645d on hv-cinder-81565 May 12 21:07:29.720429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [req-f351c709-2bc1-4098-8976-3ba3109cd8ec req-959bad25-a0fc-49cf-8b7e-d639e6666094 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091010 May 12 21:07:29.721010 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1005/1989] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:07:29.947233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:29.947796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:29.954234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:29.954692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:29.956032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:29.956535 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:30.018663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:30.026390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bf56f48a-d7f1-4994-9e74-c4df7fc38838 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083176 May 12 21:07:30.026946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 985/1990] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:29 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:31.044932 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:31.045674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:31.052494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:31.052950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:31.053746 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:31.054187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:31.114650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:31.122434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-68da4589-b02d-40b4-bfba-abe3662e26a2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082201 May 12 21:07:31.122987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1006/1991] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:32.140013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:32.140556 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:32.147369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:32.147818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:32.148581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:32.149026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:32.211126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:32.219147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2725e659-962e-465c-962e-ab9ef2198bb5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083374 May 12 21:07:32.219710 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 986/1992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:33.236762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:33.237382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:33.243983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:33.244429 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:33.245203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:33.245669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:33.307547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:33.316031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-be6aac77-4c82-44d8-ba90-7466d252279d tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083352 May 12 21:07:33.316609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1007/1993] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:33 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:34.333168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:34.333911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:34.340166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:34.340613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:34.341400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:34.341837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:34.405552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:34.413743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-44d528ff-b267-47c8-bc0d-77899bdd5888 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084911 May 12 21:07:34.414239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 987/1994] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:35.431389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:35.432080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:35.438460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:35.438919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:35.440259 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:35.440925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:35.558322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:35.566868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c8ebc8ec-9a32-4a1a-98c2-ff2a8728ccc0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.139397 May 12 21:07:35.567421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1008/1995] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:35 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:36.583616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:36.584230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:36.590504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:36.590951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:36.591712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:36.592146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:36.654097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:36.662223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-16ef7024-2983-42d5-acee-0a0a237c4f9e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082467 May 12 21:07:36.662785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 988/1996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:36 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:37.679160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:37.679774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:37.686402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:37.686927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:37.687689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:37.688124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:37.751651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:37.759933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-caf4361e-ad1d-44a4-9b06-a3ccb31be638 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084720 May 12 21:07:37.760486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1009/1997] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:37 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:38.778333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:38.778974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:38.786477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:38.786928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:38.787692 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:38.788125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:38.849616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:38.857433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-66830a08-2819-4e93-84b6-96f3bb16d23b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082899 May 12 21:07:38.858010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 989/1998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:38 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:39.874611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:39.875230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:39.882192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:39.882647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:39.883427 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:39.883863 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:39.944540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:39.952471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-508a8814-1214-494f-b302-792a89046189 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081688 May 12 21:07:39.953027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1010/1999] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:39 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:40.970110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:40.971563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:40.977929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:40.978385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:40.979163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:40.979661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:41.042219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:41.050404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d8d71bcf-3b82-4881-906a-86d8ddfe5083 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084169 May 12 21:07:41.050951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 990/2000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:40 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:42.067782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:42.068405 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:42.074793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:42.075245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:42.076011 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:42.076449 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:42.138140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:42.145824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-efcda56f-3343-428a-8389-cf442708109e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082343 May 12 21:07:42.146367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1011/2001] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:42 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:43.164554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:43.165150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:43.172062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:43.172713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:43.174470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:43.175119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:43.259029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:43.267255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e40df9d0-93d6-44a6-9ca4-ac5fa6cae208 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.108062 May 12 21:07:43.268418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 991/2002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:43 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:44.284799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:44.285578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:44.292822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:44.293299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:44.294791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:44.294791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:44.357421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:44.365803 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-db03d6eb-7d59-446e-aa52-e352ce4215bd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084949 May 12 21:07:44.366371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1012/2003] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:44 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:45.384191 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:45.384916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:45.393029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:45.393303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:45.393942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:45.394381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:45.473448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:45.481378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d783103b-47ba-4e1d-8c0b-93197539811e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.101491 May 12 21:07:45.482028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 992/2004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:45 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:46.500238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:46.500826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:46.507200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:46.507646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:46.508402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:46.508833 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:46.575440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:46.584188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5ed0c516-961b-4ba1-9978-7d54f8dfc1c0 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.087970 May 12 21:07:46.584764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1013/2005] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:46 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:47.601664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:47.602272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:47.608715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:47.609174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:47.609973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:47.610415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:47.671958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:47.680514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6ef0a0c4-5127-4001-883b-4636c5bbed87 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082790 May 12 21:07:47.681071 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 993/2006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:47 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:48.697641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:48.698247 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:48.705523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:48.706058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:48.706893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:48.707334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:48.770958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:48.778990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-926fdbfd-d999-4584-8bc0-fb352e6d6099 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.085298 May 12 21:07:48.779556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1014/2007] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:48 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:49.797157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:49.797822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:49.805351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:49.805808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:49.806581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:49.807016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:49.869054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:49.877300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-606cc4d3-f655-4340-a8f0-e4884ebdd978 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084154 May 12 21:07:49.877871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 994/2008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:49 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:50.895342 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:50.895972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:50.902057 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:50.902507 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:50.903268 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:50.903698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:50.965571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:50.974188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-721aaa26-a5d0-463f-86c1-50cb06746325 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083556 May 12 21:07:50.974755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1015/2009] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:50 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:51.991530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:51.992160 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:51.998592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:51.999044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:51.999816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:52.000257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:52.064384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:52.072322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d1529efb-498a-49ec-be04-74a37c109402 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084694 May 12 21:07:52.072881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 995/2010] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:51 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:53.089411 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:53.090032 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:53.096299 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:53.096766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:53.097574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:53.098015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:53.158919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:53.167323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1649956-2cf5-40b1-86bf-4ff310d1bad1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081912 May 12 21:07:53.167884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1016/2011] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:53 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:54.184961 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:54.185617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:54.192121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:54.192575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:54.193373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:54.193814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:54.255390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:54.263503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8e95c965-4e52-4fb5-bc8f-7eb851c1a599 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082414 May 12 21:07:54.264656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 996/2012] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:54 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:55.281414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:55.282006 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:55.289084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:55.289572 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:55.290335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:55.290796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:55.354688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:55.362451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-76ddc040-af9e-431f-811d-6c02908d99a6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.085037 May 12 21:07:55.363015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1017/2013] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:55 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:56.380017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:56.380955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:56.387527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:56.387972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:56.388723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:56.389157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:56.452532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:56.460768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1fec728e-202e-4f73-b94f-8c48c2fa7a20 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084601 May 12 21:07:56.461346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 997/2014] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:56 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:57.477975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:57.478574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:57.484906 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:57.485390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:57.486157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:57.486597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:57.547186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:57.555813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-da8e4a32-dc8f-4de0-be47-4b1b770691b1 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082297 May 12 21:07:57.556378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1018/2015] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:57 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:58.572696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:58.573257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:58.579502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:58.579946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:58.580694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:58.581137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:58.642475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:58.650133 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0ce154a1-dddd-4efb-8727-f69cf34fc132 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081987 May 12 21:07:58.650694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 998/2016] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:58 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:07:59.667354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:07:59.667984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:07:59.674358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:59.674820 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:59.675596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:07:59.676069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:07:59.737385 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:07:59.745481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a2b053e-133d-4a9c-9391-c8b126c96444 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082068 May 12 21:07:59.746046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1019/2017] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:07:59 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:00.763002 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:00.763774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:00.770064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:00.770511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:00.771303 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:00.771774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:00.835413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:00.843184 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-46003247-6dd4-432a-b022-6bb10450647a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084285 May 12 21:08:00.843743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 999/2018] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:00 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:01.860436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:01.861104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:01.867721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:01.868182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:01.868959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:01.869424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:01.929857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:01.937731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4f13083c-4621-4d20-b1be-e129174244e6 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081211 May 12 21:08:01.938294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1020/2019] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:01 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:02.955112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:02.955731 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:02.962755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:02.963206 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:02.963976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:02.964415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:03.027289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:03.035143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d224b5a2-2ee0-4505-9887-448531594e68 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083951 May 12 21:08:03.035704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1000/2020] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:02 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:04.051967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:04.052580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:04.059148 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:04.059599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:04.060373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:04.060815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:04.127150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:04.135537 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1b1fab16-1553-48ad-b1e4-df6790580fc9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.087425 May 12 21:08:04.140691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1021/2021] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:04 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:05.156630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:05.157223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:05.163640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:05.164103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:05.164875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:05.165381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:05.226609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:05.234373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-720ced00-b19f-4f1a-95a7-77d992af17c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081730 May 12 21:08:05.234945 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1001/2022] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:05 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:08:06.252171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:06.252786 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:06.259536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:06.259982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:06.260757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:06.261481 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:06.323673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:06.331377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-40341321-3974-4fb0-a0a5-d9ac61ab079b tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083094 May 12 21:08:06.331936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1022/2023] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:06 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:07.350187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:07.350998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:07.357321 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:07.357769 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:07.358536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:07.358969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:07.418997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:08:07.419419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:08:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:08:07.421014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:07.429790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1a556d8f-cccd-4e93-9327-e9c0bc8fe587 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084202 May 12 21:08:07.430364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1002/2024] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:07 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:08.447499 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:08.448069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:08.454294 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:08.454738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:08.455489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:08.455919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:08.516130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:08.524046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7db28589-005b-421d-9b5b-4c2a321e0c11 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081247 May 12 21:08:08.524612 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1023/2025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:08 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:09.541755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:09.542368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:09.548832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:09.549301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:09.550127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:09.550570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:09.617870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:09.625702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-beecc606-d886-46c6-bf3e-06e42664ae2c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.088547 May 12 21:08:09.626262 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1003/2026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:09 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:10.642733 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:10.643367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:10.650552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:10.650999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:10.651753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:10.652182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:10.715450 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:10.723339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-982b34c8-75db-4026-b104-f2d264437f08 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084511 May 12 21:08:10.723905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1024/2027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:10 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:11.740870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:11.741661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:11.748203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:11.748656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:11.749633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:11.750072 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:11.811886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:11.820129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0e2a4613-c912-4945-a928-7ad12e491689 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084035 May 12 21:08:11.820675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1004/2028] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:11 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:12.395288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:08:12.395445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:08:12.837610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:12.838362 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:12.844698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:12.845150 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:12.845963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:12.846407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:12.911573 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:12.920110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cb424709-c6ca-452c-939f-c3fd1764c48e tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.086448 May 12 21:08:12.920676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1025/2029] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:12 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:13.937598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:13.938209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:13.944910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:13.945384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:13.946176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:13.946609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:14.007639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:14.015647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-23b892ce-6c0a-48ac-8507-1c2aff0aa0c2 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082054 May 12 21:08:14.016229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1005/2030] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:13 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:15.033367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:15.034013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:15.040916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:15.041396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:15.042154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:15.042587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:15.103954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:15.111773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b1c87857-bc76-4b2f-b5f3-68e93b275fef tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082405 May 12 21:08:15.112332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1026/2031] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:15 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:16.129309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:16.129955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:16.136948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:16.137434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:16.138203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:16.138635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:16.200755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:16.208847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d2eddd64-41cc-4ce2-8a41-57fd320585e8 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083334 May 12 21:08:16.209528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1006/2032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:16 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:17.226772 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:17.227391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:17.233914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:17.234358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:17.235115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:17.235547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:17.298986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:17.307188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-16b18b7d-9998-4c40-95d2-edb529bb4299 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.085367 May 12 21:08:17.307750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1027/2033] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:17 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:18.324634 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:18.325413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:18.331886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:18.332362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:18.333124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:18.334529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:18.398553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:18.406326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5696f147-0964-4638-83d5-34aec7e096b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.085574 May 12 21:08:18.406903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1007/2034] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:18 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:19.424026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:19.424658 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:19.431981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:19.432435 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:19.433200 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:19.433663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:19.493586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:19.501304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a5f44232-b94d-4866-8498-f622daa75797 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081174 May 12 21:08:19.501856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1028/2035] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:19 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:20.518298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:20.518884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:20.525606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:20.526054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:20.526815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:20.527279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:20.588015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:20.595751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-156d300f-15b2-4494-ae2f-3f554323021f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081377 May 12 21:08:20.596305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1008/2036] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:20 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:21.613728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:21.614761 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:21.621955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:21.622406 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:21.623167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:21.623599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:21.688952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:21.697331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9cabc56b-5ff3-4e2d-8c67-071d9e023fdc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.087520 May 12 21:08:21.697891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1029/2037] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:21 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:22.714446 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:22.715063 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:22.721351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:22.721801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:22.722561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:22.722996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:22.784276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:22.792698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e8b6f86d-6e2d-4282-90e6-b68cf78a288a tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082148 May 12 21:08:22.793259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1009/2038] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:22 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:23.810358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:23.810989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:23.817288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:23.818643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:23.818643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:23.819104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:23.880586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:23.888735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-928ba69b-7d20-416a-971f-9d2f7c4c6793 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.082288 May 12 21:08:23.889319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1030/2039] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:23 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:08:24.905065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:24.905705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:24.912170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:24.912625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:24.913422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:24.913858 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:24.978385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:24.986286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-27163a96-4588-4553-b715-af80e58ba9c5 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.085103 May 12 21:08:24.986843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1010/2040] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:24 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:26.003986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:26.004579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:26.011958 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:26.012402 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:26.013160 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:26.013622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:26.073909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:26.081870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6324ddf9-bea2-4f22-8602-71606e835b54 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081742 May 12 21:08:26.082426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1031/2041] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:25 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:27.099741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:27.100353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:27.106720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:27.107179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:27.107923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:27.108355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:27.175990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:27.184509 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-feef741f-546e-43c4-a383-d7fbe2dd51b9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.088976 May 12 21:08:27.185082 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1011/2042] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:27 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:28.202417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:28.203027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:28.210347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:28.210796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:28.211556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:28.211996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:28.272738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:28.280506 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-81e23dbe-396d-4434-92a3-211557b44e1c tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.081983 May 12 21:08:28.281056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1032/2043] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:28 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:29.298442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:29.299059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:29.306083 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:29.306532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:29.307310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:29.307751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:29.414632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:29.422730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f7a30da-cf1d-4191-8e7e-cd8819a02670 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.128176 May 12 21:08:29.423416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1012/2044] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:29 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:08:30.440751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:30.441408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:30.447852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:30.448300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:30.449052 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:30.449660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:30.513390 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:30.521830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e97939f8-40be-4b50-806f-eeba84851e75 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.084695 May 12 21:08:30.522702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1033/2045] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:30 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:31.540015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:31.547795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:31.547795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:31.547795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:31.548307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:31.548746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:31.610590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:31.619302 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-48410375-99e4-4174-9231-638f5593a8cc tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.083763 May 12 21:08:31.619875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1013/2046] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:31 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:32.636933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:32.637613 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:32.643930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:32.644380 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:32.645781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:32.646415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:32.711111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:32.719186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8099fa89-be52-4c6c-a279-9bfcdeb9affd tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.086401 May 12 21:08:32.719819 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1034/2047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:32 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:33.741142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:33.741911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:33.748351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:33.748809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:33.749616 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:33.750086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:33.814581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:33.823165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6421c29e-5e0f-45b9-b306-a5a22be3e0e9 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.086541 May 12 21:08:33.823729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1014/2048] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:33 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:08:34.840207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:08:34.840832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 10ab3d9c-d609-4b71-98bf-2b56f872645d] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:08:34.847563 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:34.848015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:34.848908 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:08:34.849660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:08:34.915244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.policy [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4df001beaca4de2a8e15c26b31a9168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f403a1bdf48db8bec832b39b8f391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129358) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:08:34.923278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-07a6c5cf-53c5-46a5-8025-3287cd097a77 tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] 10.222.0.59 "GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d" status: 200 len: 1349 microversion: 2.1 time: 0.086902 May 12 21:08:34.923843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1035/2049] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:08:34 2022] GET /compute/v2.1/servers/10ab3d9c-d609-4b71-98bf-2b56f872645d => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:09:29.195891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:29.196520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:29.203548 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:29.204010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:29.204803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:29.205242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:29.220111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef HTTP/1.1 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:09:29.221733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.223340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '8d5aa200-1fb8-4cde-b379-333b9b415aef'} May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:09:29.224319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.225868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:09:29.228197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:09:29.228197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5f75b9d1-538b-46b9-9c38-185337155938 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 404 len: 111 microversion: 2.1 time: 0.033077 May 12 21:09:29.228197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1015/2050] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:09:29 2022] DELETE /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 21:09:29.232444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:29.233221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] [instance: 8d5aa200-1fb8-4cde-b379-333b9b415aef] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:29.239004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:29.239685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:29.240469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:29.240912 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:29.254459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.wsgi [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] HTTP exception thrown: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Request method failure captured: May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: request: GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef HTTP/1.1 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept: application/json May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Accept-Encoding: identity May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Connection: close May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Length: 0 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Content-Type: application/json May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Host: 10.222.0.59 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Openstack-System-Scope: None May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: User-Agent: python-urllib3/1.26.9 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Auth-Token: gAAAAABifXAz0wpTNHPw7iDYbDEh7IexHHzFf0B2Z9gJhpZ1U4HHpTTIAh4yAyWKCy5tTle6hV31E4QiV8we8bvELdhSZpig0gHtWlg4mE42g4m45HgXwDqwC7bijgwBmf5YPdAQYdRGNvd55CJ1zkV6BUoHrZA8druPKkX1CrjafSI5I5phOKU May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Id: None May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Domain-Name: None May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Identity-Status: Confirmed May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Is-Admin-Project: True May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Id: default May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Domain-Name: Default May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Project-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Role: member,reader May 12 21:09:29.256134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Roles: member,reader May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bec19c8306c6439b9392248450d21ec9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bec19c8306c6439b9392248450d21ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Id: bec19c8306c6439b9392248450d21ec9 May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-95702506 May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Id: default May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Domain-Name: Default May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Id: 606b53c6f60d45cf9e2c3e5c6c9cde2e May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: X-User-Name: tempest-AttachVolumeNegativeTest-95702506-project May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: method: > May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: exception: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.262031 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: action_args: {'id': '8d5aa200-1fb8-4cde-b379-333b9b415aef'} May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:09:29.263685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. May 12 21:09:29.266125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: ERROR nova.api.openstack.wsgi May 12 21:09:29.267617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] Returning 404 to user: Instance 8d5aa200-1fb8-4cde-b379-333b9b415aef could not be found. {{(pid=129358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:09:29.267617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ecf39beb-c425-47ac-b082-dbdce4188b58 tempest-AttachVolumeNegativeTest-95702506 tempest-AttachVolumeNegativeTest-95702506-project] 10.222.0.59 "GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef" status: 404 len: 111 microversion: 2.1 time: 0.029677 May 12 21:09:29.267617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1036/2051] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:09:29 2022] GET /compute/v2.1/servers/8d5aa200-1fb8-4cde-b379-333b9b415aef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 21:09:30.090418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:30.091529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:30.098611 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:30.099064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:30.099847 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:30.100357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:30.133827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d2e77033-e59e-4e30-b2d9-cb05da2e411d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048013 May 12 21:09:30.134420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1016/2052] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:31.219904 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:31.220852 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:31.227440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:31.227893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:31.228690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:31.229122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:31.264388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c635fca8-292c-443f-ab45-8830d8453090 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.122199 May 12 21:09:31.268298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1037/2053] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:09:32.277090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:32.278623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:32.285501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:32.285953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:32.286726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:32.287163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:32.319974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-92f856c4-b3f3-436b-b6f7-10bd22776c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047596 May 12 21:09:32.325335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1017/2054] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:33.331924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:33.332840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:33.339177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:33.339623 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:33.340437 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:33.341546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:33.370628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a92f338-94f6-45aa-8e7b-f479f5595101 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042700 May 12 21:09:33.371175 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1038/2055] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:34.382630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:34.383553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:34.390859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:34.391305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:34.392078 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:34.392510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:34.424003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-11a52474-ac29-45f1-a480-ee15b4c41d29 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045429 May 12 21:09:34.424558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1018/2056] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:35.436884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:35.437851 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:35.444580 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:35.445446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:35.445836 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:35.446333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:35.477424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-50d6323f-19e9-4648-aba2-be2e379c0a21 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045590 May 12 21:09:35.477994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1039/2057] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:36.489214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:36.490098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:36.496378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:36.496829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:36.497883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:36.498429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:36.527366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-84740c2b-9a57-4bce-b261-b9f9f4b9ed44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042191 May 12 21:09:36.527914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1019/2058] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:09:37.539837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:37.540837 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:37.547924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:37.548376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:37.549140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:37.549607 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:37.578973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9274e437-58ae-4382-9278-641f36e7d779 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043221 May 12 21:09:37.579519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1040/2059] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:38.590659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:38.592289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:38.598712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:38.599160 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:38.599916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:38.600387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:38.629392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4263b86f-a1fe-4ae4-bd34-ceec2b5eb7a4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042608 May 12 21:09:38.629939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1020/2060] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:39.642080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:39.643014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:39.649522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:39.649981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:39.650757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:39.651203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:39.682042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a5938ea6-c1e3-421c-84c4-94602044aa8a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044564 May 12 21:09:39.682609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1041/2061] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:40.694873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:40.695802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:40.703066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:40.703527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:40.704298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:40.704742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:40.734583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-821365b3-84ef-49b6-81b3-d458e2e24580 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043821 May 12 21:09:40.735135 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1021/2062] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:41.552497 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:09:41.552812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:09:41.745915 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:41.746867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:41.753857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:41.754360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:41.755171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:41.755603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:41.789249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-18f09fd8-6367-4ab9-8e4f-be3db9d46fa6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047254 May 12 21:09:41.790121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1042/2063] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:42.801584 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:42.802420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:42.808837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:42.809293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:42.810806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:42.811246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:42.843843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1f54d7ad-7597-45d2-aec5-35ec3e291c02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046054 May 12 21:09:42.844758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1022/2064] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:43.856153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:43.858047 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:43.864436 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:43.864889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:43.865728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:43.866155 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:43.896128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a7fc8e4-0adb-4294-ae27-32824073f497 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043941 May 12 21:09:43.896689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1043/2065] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:44.908708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:44.909666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:44.916119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:44.916579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:44.917417 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:44.917864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:44.947886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8dcf2a28-758b-42de-8f98-4dc485d95f80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043303 May 12 21:09:44.948449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1023/2066] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:45.960202 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:45.961186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:45.968301 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:45.968744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:45.969522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:45.969956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:45.998889 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d8a45d4a-156a-4c05-96ff-05033dc19a7e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042746 May 12 21:09:45.999442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1044/2067] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:47.014605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:47.015697 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:47.022771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:47.023216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:47.023981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:47.024412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:47.063444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e802cf9d-bef3-4f20-bd46-f2cbd82d452c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055709 May 12 21:09:47.064343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1024/2068] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:48.076290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:48.077706 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:48.083945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:48.084391 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:48.085152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:48.085611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:48.116147 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c4ed84d3-d99b-4f47-98b3-751f881d13d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043695 May 12 21:09:48.116882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1045/2069] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:49.128410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:49.129299 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:49.135654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:49.136357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:49.137126 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:49.137586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:49.167328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e8220875-e380-4bad-bf07-790ae550d517 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043693 May 12 21:09:49.167881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1025/2070] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:50.180079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:50.180940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:50.187319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:50.187764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:50.188519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:50.188951 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:50.219237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0b578e3b-6cd1-4898-817c-04792866cc23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043314 May 12 21:09:50.219780 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1046/2071] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:51.230911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:51.231752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:51.238702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:51.239273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:51.240062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:51.240486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:51.270149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bea5ec90-6cab-4d60-a6d4-2fe9148372d8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043245 May 12 21:09:51.270707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1026/2072] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:52.282002 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:52.282935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:52.289220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:52.289699 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:52.290465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:52.290901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:52.319929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ffd4d56b-766a-4d61-aff1-e2c3dfc65b60 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042054 May 12 21:09:52.320480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1047/2073] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:53.332353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:53.333211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:53.339505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:53.339954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:53.340711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:53.341141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:53.377889 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ec7c3445-aba0-410f-a9fd-6759d6780b0f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049524 May 12 21:09:53.378455 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1027/2074] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:09:54.390141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:54.391067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:54.397488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:54.397943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:54.398707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:54.399144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:54.429505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e757c6a6-3e9f-4d0f-b749-e0e1d952b583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043772 May 12 21:09:54.430105 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1048/2075] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:55.443646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:55.444946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:55.451519 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:55.452176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:55.452871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:55.453335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:55.484363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f420439d-1f5c-47a0-8715-99f4d0dfad50 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046829 May 12 21:09:55.484946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1028/2076] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:56.496578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:56.497455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:56.504611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:56.505061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:56.505856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:56.506285 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:56.535583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f6121107-6246-4d02-9966-2ceb42e5c544 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043005 May 12 21:09:56.536128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1049/2077] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:57.548398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:57.549229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:57.555599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:57.556042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:57.556797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:57.557228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:57.587480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4521ad8b-1e2b-4e9b-bdfc-4bb5ef7cb2e3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044144 May 12 21:09:57.588033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1029/2078] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:58.599335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:58.600248 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:58.606493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:58.606943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:58.608584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:58.609023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:58.638550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7993fddb-4e32-4d84-8b31-38c5b7d543dd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043143 May 12 21:09:58.639395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1050/2079] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:09:59.650754 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:09:59.651705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:09:59.659440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:59.659900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:59.660705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:09:59.661149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:09:59.694927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-267800ff-d28e-42a2-9d3c-0c94b382aa01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048180 May 12 21:09:59.695521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1030/2080] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:09:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:00.707171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:00.708111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:00.714467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:00.714923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:00.715687 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:00.716125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:00.746084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8d407789-9c28-460c-b27e-bced44f9bda8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042887 May 12 21:10:00.746637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1051/2081] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:01.636064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:10:01.636913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:10:01.757458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:01.758419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:01.765520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:01.765975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:01.766750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:01.767190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:01.799424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b998083f-7495-4ee3-b654-ddfc4189cd5c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046000 May 12 21:10:01.800162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1031/2082] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:02.811762 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:02.812680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:02.819000 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:02.819441 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:02.820190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:02.820618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:02.850266 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2cfdd378-d345-4980-a4e0-284caf9605ea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042953 May 12 21:10:02.850822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1052/2083] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:03.861713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:03.862652 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:03.868979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:03.869472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:03.870249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:03.870689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:03.899992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c339167e-616c-45aa-b83f-3ee78560e34c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042862 May 12 21:10:03.900532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1032/2084] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:04.911243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:04.914130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:04.918547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:04.918998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:04.919771 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:04.920203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:04.950674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3a94570c-047d-41fa-89d9-d0ef721e6697 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043393 May 12 21:10:04.954252 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1053/2085] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:05.963197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:05.964171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:05.971471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:05.971929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:05.972711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:05.973153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:06.002269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9baa16cc-092a-44a5-9a0f-244165920292 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043029 May 12 21:10:06.002819 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1033/2086] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:07.014662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:07.015601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:07.022289 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:07.022749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:07.023525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:07.023971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:07.053066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-16842851-96b7-4e06-8de6-e3684ed1e970 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042639 May 12 21:10:07.053648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1054/2087] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:10:08.064529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:08.065614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:08.071955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:08.072405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:08.073176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:08.073648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:08.103124 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e7c2bff6-320a-4271-9792-2401f534aac9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043277 May 12 21:10:08.103680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1034/2088] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:09.114950 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:09.115787 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:09.122037 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:09.122492 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:09.123261 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:09.123695 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:09.153609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9107b748-27ac-437a-ac7a-92e6031b969d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042657 May 12 21:10:09.154162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1055/2089] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:10.166129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:10.166967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:10.174571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:10.175027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:10.175791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:10.176234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:10.204895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c101c12a-23c6-4f53-b9a6-f12538455fd4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042782 May 12 21:10:10.205477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1035/2090] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:10.750673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:10:10.750673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:10:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:10:11.216185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:11.217111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:11.223901 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:11.224350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:11.225110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:11.225569 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:11.256020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3d19c229-51e5-430d-afbb-7cdaa92f28c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043797 May 12 21:10:11.256570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1056/2091] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:12.268118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:12.269073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:12.275530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:12.275976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:12.276733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:12.277165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:12.306483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9d2938d1-2456-43f2-97fc-4c394b513023 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042659 May 12 21:10:12.307032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1036/2092] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:13.318072 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:13.318989 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:13.325213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:13.325690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:13.326444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:13.326870 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:13.357717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ab72d8c6-2d5a-49dc-95f8-06172a4a48ac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043748 May 12 21:10:13.358276 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1057/2093] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:14.370291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:14.371212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:14.377486 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:14.377931 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:14.378689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:14.379118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:14.409881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1554b483-90fe-499a-938d-a90870542fdb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043527 May 12 21:10:14.410424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1037/2094] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:15.421707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:15.422626 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:15.428956 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:15.429448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:15.430207 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:15.430648 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:15.462520 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-df6879a9-d618-4166-9494-0ce026f0e583 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044797 May 12 21:10:15.463091 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1058/2095] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:16.474532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:16.475456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:16.481812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:16.482270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:16.483032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:16.483464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:16.513949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-402510c7-e8f0-48a9-9eea-21f9ffaad2b3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043462 May 12 21:10:16.514420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1038/2096] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:17.526033 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:17.526979 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:17.534241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:17.534690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:17.535445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:17.535876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:17.574941 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-150fc34d-f979-4c58-b6ac-6ff6017700ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052842 May 12 21:10:17.575495 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1059/2097] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:18.586603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:18.587525 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:18.593825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:18.594275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:18.595599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:18.596039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:18.624594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d5b131e8-9b24-425c-98e1-ceafdba98eb4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041947 May 12 21:10:18.625134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1039/2098] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:19.637487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:19.638439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:19.645541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:19.645997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:19.646763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:19.647203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:19.677124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8b2e13dc-a82e-45c0-b70b-c13727a1e0f4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043901 May 12 21:10:19.677721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1060/2099] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:20.688158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:20.689151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:20.695470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:20.695924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:20.696693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:20.697132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:20.727253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a4ec6bcc-ba7e-44ad-984f-e093d9d13399 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043053 May 12 21:10:20.727802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1040/2100] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:21.739045 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:21.739971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:21.746119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:21.746574 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:21.747340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:21.747783 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:21.784554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-47a6a628-50e2-49d8-a85a-8e3f5b9e1467 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049261 May 12 21:10:21.785585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1061/2101] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:22.796161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:22.797109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:22.804187 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:22.804646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:22.805441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:22.805880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:22.834680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c9ff0e2-e227-4c65-8b8d-43bf4e3aee8d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042452 May 12 21:10:22.835232 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1041/2102] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:23.847080 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:23.848742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:23.858287 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:23.858981 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:23.860168 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:23.861562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:23.892842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8f8cb1ba-43c0-4ce1-b041-8d0bd2e9d4b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050314 May 12 21:10:23.893457 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1062/2103] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:24.908203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:24.913776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:24.915559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:24.916013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:24.916775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:24.917209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:24.948020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b0f9021c-39ba-41e6-b8eb-9e9199fc18f7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043717 May 12 21:10:24.953870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1042/2104] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:25.960660 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:25.961625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:25.967980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:25.968428 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:25.969180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:25.969639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:25.998490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b5cfbc2c-ccd9-4a41-b22a-dce790f91fcd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041942 May 12 21:10:25.999034 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1063/2105] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:27.010103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:27.011053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:27.018426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:27.018875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:27.019641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:27.020082 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:27.049797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3fbace9b-37c6-401d-b589-fbd3fd1befdd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043494 May 12 21:10:27.050351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1043/2106] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:28.061804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:28.062756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:28.069519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:28.069975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:28.070734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:28.071169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:28.100408 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-11cb96f0-2c2d-4b7c-9a94-e34300d206cf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042574 May 12 21:10:28.100960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1064/2107] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:29.113449 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:29.114331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:29.120946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:29.121443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:29.122228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:29.122669 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:29.155076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8c35da7e-dd47-44e4-84e7-50582ad23c30 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046472 May 12 21:10:29.159739 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1044/2108] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:30.167754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:30.168630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:30.175691 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:30.176223 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:30.177066 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:30.177662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:30.218824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ae918760-c796-4eef-8fca-8cdf5e464518 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055098 May 12 21:10:30.219916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1065/2109] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:31.231475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:31.232336 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:31.238962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:31.239416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:31.240178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:31.240625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:31.270699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4a08c511-3509-4bc4-841d-f80ec53f98c0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043298 May 12 21:10:31.271251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1045/2110] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:32.282562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:32.283793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:32.290222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:32.290681 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:32.291445 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:32.291884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:32.321918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2e0dc874-bb1c-40ff-bdae-c187bf87603a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043382 May 12 21:10:32.322468 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1066/2111] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:33.333224 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:33.334146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:33.340440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:33.340891 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:33.341675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:33.342111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:33.371476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1d757f8c-d270-43e8-9b8b-8b01cb164124 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042307 May 12 21:10:33.372005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1046/2112] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:34.383651 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:34.384628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:34.391276 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:34.391731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:34.393065 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:34.393530 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:34.421758 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-98511179-19a4-4227-8dfd-5c7f67bb5566 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042012 May 12 21:10:34.422304 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1067/2113] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:10:35.434216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:35.435157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:35.442175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:35.448816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:35.448816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:35.448816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:35.474490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-88480ca5-658f-4606-acc6-095c3eaad0ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044182 May 12 21:10:35.475040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1047/2114] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:10:36.487098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:36.488023 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:36.494351 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:36.494800 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:36.495561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:36.495997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:36.531764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fec371c8-177d-4c76-8126-170acf38e4cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049279 May 12 21:10:36.532251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1068/2115] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:37.543479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:37.544403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:37.550932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:37.551390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:37.552156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:37.552598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:37.581588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e1381f04-7607-4ee8-9725-0dc356a48fea tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042051 May 12 21:10:37.582132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1048/2116] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:38.593290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:38.594238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:38.600654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:38.601101 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:38.601885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:38.602319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:38.632291 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-daea480e-ee59-40c2-9177-80e99d7d495e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042971 May 12 21:10:38.632844 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1069/2117] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:39.646551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:39.647464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:39.654054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:39.654508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:39.655283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:39.655729 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:39.687374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-544e4a7a-b3d7-4b6f-bef7-031a56df8002 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047009 May 12 21:10:39.687977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1049/2118] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:40.699921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:40.700867 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:40.707144 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:40.707609 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:40.708370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:40.708811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:40.738459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e4c9ecf-42c4-4a62-a26a-f1945588dab6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042552 May 12 21:10:40.739018 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1070/2119] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:41.750305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:41.751259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:41.758989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:41.758989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:41.759949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:41.760386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:41.791065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-01b40a22-c55f-4518-85a6-e582a248aea9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044618 May 12 21:10:41.791539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1050/2120] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:42.802985 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:42.803939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:42.810209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:42.810663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:42.811421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:42.811860 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:42.848899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c88c41ee-a430-4295-a0ae-39b0a176d80e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049994 May 12 21:10:42.849490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1071/2121] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:43.860682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:43.862454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:43.868511 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:43.868966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:43.869758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:43.870195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:43.899171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f2f6b4a-05d0-4c44-8ef6-4aca29e04364 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042494 May 12 21:10:43.899728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1051/2122] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:44.910358 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:44.911272 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:44.917546 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:44.918001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:44.918753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:44.919187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:44.949532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-de1b462b-754b-478c-bea5-1f0f06d84226 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043056 May 12 21:10:44.950073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1072/2123] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:45.961593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:45.962893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:45.970016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:45.970671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:45.971656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:45.972097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:46.016171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d405f2ae-2da8-4a74-8ccf-cd8b7288c2b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058271 May 12 21:10:46.016780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1052/2124] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:47.028659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:47.029534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:47.036460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:47.036918 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:47.037718 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:47.038164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:47.067769 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14582083-95d6-4969-9dde-7a4841c61ef5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043151 May 12 21:10:47.068323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1073/2125] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:48.080243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:48.081158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:48.087402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:48.087845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:48.088595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:48.089024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:48.119197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bc918c1a-ea5b-4e74-ac3c-0d744f06f907 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043317 May 12 21:10:48.119676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1053/2126] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:49.131237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:49.132055 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:49.138731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:49.139176 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:49.139923 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:49.140354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:49.169936 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-773d389e-dafc-4717-9726-cffee337a13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042983 May 12 21:10:49.170485 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1074/2127] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:50.182836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:50.183677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:50.190521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:50.190967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:50.191722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:50.192158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:50.222450 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4e92636b-acd2-475b-95c1-c032242843b7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043644 May 12 21:10:50.222998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1054/2128] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:51.234292 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:51.235121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:51.241885 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:51.242334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:51.243095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:51.243525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:51.273143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-95d13346-5243-4676-932e-90e3bb963a71 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043077 May 12 21:10:51.273726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1075/2129] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:52.284598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:52.285561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:52.291922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:52.292370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:52.293131 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:52.293588 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:52.323624 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-554bd5c9-1d71-48f0-88dc-4bc65db97d36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043521 May 12 21:10:52.324171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1055/2130] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:53.336226 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:53.337185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:53.343616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:53.344067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:53.344826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:53.346157 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:53.374744 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a0b1a2b4-183a-44b3-9c8b-7c21c40ba098 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042571 May 12 21:10:53.375302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1076/2131] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:54.386867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:54.388109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:54.394722 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:54.399340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:54.399340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:54.399340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:54.426671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a026bb48-807c-4f02-9f86-a83bd1d3813a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043883 May 12 21:10:54.427227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1056/2132] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:55.437549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:55.438496 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:55.444914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:55.445396 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:55.446163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:55.446600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:55.476076 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-260df9fb-9c16-41b2-ba95-3d68ccf79b23 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042531 May 12 21:10:55.476621 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1077/2133] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:56.488225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:56.489145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:56.495415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:56.495863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:56.496615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:56.497048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:56.526778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-47135f20-29a2-4de7-937f-17c14ef8ef0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042928 May 12 21:10:56.527244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1057/2134] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:57.539329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:57.540317 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:57.546895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:57.547348 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:57.548333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:57.548777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:57.578600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-88b7b844-4155-4b76-acd2-cb4b2bf068d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043270 May 12 21:10:57.579154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1078/2135] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:58.590530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:58.591460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:58.598006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:58.598460 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:58.599229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:58.599668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:58.629257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-30776629-e67d-4e48-9336-418c8471b31b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042726 May 12 21:10:58.629827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1058/2136] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:10:59.641101 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:10:59.643173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:10:59.649534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:59.649982 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:59.650735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:10:59.651166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:10:59.681433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cf5e6748-00cb-436c-91c6-d3d406aa63c6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044437 May 12 21:10:59.682035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1079/2137] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:10:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:00.692618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:00.693596 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:00.699912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:00.700363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:00.701123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:00.701595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:00.731570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e945f49d-0f28-4e98-a1eb-5e7b004f6d02 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043012 May 12 21:11:00.732115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1059/2138] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:01.745845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:01.746805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:01.752861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:01.753329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:01.754113 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:01.754550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:01.785676 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-67d5e72a-ad90-4967-a64b-3aadf2929967 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045849 May 12 21:11:01.786244 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1080/2139] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:02.797501 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:02.798709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:02.805020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:02.805510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:02.806267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:02.806699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:02.836431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0fcd7197-7125-4601-bdb6-1eb4cfadaf1c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042987 May 12 21:11:02.836972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1060/2140] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:03.848987 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:03.850075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:03.856469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:03.856943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:03.857739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:03.858177 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:03.889152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c4b56c75-8b4d-4a39-be81-aff89c08b941 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044886 May 12 21:11:03.889734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1081/2141] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:11:04.900775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:04.901756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:04.908783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:04.909258 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:04.910066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:04.910508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:04.946907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-70c378d6-74a9-428e-883c-83bd703ffd78 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050070 May 12 21:11:04.947825 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1061/2142] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:05.959879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:05.960821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:05.967069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:05.967515 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:05.968262 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:05.968690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:05.997872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-334aa87c-59dc-49d5-909b-ff8074957269 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042054 May 12 21:11:05.998419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1082/2143] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:07.009679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:07.010595 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:07.017570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:07.018023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:07.018778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:07.019211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:07.049404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5cc0e117-c62a-4378-a11d-4b25aa0f1864 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042636 May 12 21:11:07.049958 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1062/2144] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:08.061339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:08.062269 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:08.069531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:08.069986 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:08.070759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:08.071201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:08.106188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3385a719-812c-4c85-ab9e-575b0ec4ee7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048756 May 12 21:11:08.106766 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1083/2145] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:09.118219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:09.119059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:09.125347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:09.125797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:09.127119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:09.127551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:09.158424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a30df4ac-0e15-4b99-ba16-2806d4a17a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043581 May 12 21:11:09.158986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1063/2146] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:10.170273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:10.171138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:10.177954 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:10.178412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:10.179185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:10.179624 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:10.209793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a1467d8b-2e6a-48d0-87ae-637f88b032de tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043531 May 12 21:11:10.210350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1084/2147] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:11.227390 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:11.228243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:11.234724 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:11.235165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:11.236050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:11.236531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:11.266305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-069eddf6-a22a-439e-8309-55c56b72eb44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048635 May 12 21:11:11.266870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1064/2148] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:12.278646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:12.279550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:12.287035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:12.287490 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:12.288257 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:12.288696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:12.318060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d87d027a-cbcb-40c3-be58-67adf5475f6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043408 May 12 21:11:12.318627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1085/2149] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:13.330381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:13.331323 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:13.337433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:13.337907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:13.338683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:13.339117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:13.368533 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ff21e521-2d20-4e16-aa4a-3cf17e1d9605 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042238 May 12 21:11:13.369079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1065/2150] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:14.380547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:14.381748 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:14.388381 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:14.389090 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:14.389888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:14.390331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:14.421106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-90b60465-15b5-4c1c-b801-1fe6f088ff3f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045304 May 12 21:11:14.421617 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1086/2151] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:15.433904 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:15.434855 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:15.441734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:15.442181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:15.442936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:15.443367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:15.474086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-02ea86a0-6505-42db-aca0-95b0b3008763 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044077 May 12 21:11:15.474650 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1066/2152] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:16.486007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:16.487004 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:16.493731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:16.494185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:16.494959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:16.495395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:16.525154 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-68c18e27-1d16-474d-950a-118bdd2c6cd7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043176 May 12 21:11:16.525738 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1087/2153] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:17.537701 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:17.538625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:17.544970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:17.545468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:17.546233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:17.546676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:17.576386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-80ec9270-8d40-4942-8554-0c91cf5c2fc4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043284 May 12 21:11:17.576943 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1067/2154] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:18.588224 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:18.589145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:18.595415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:18.595859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:18.596636 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:18.597071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:18.625892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7552d163-e2fb-4bc1-a2a5-092dc718b9fc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041644 May 12 21:11:18.626430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1088/2155] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:19.638343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:19.639527 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:19.646515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:19.646964 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:19.647717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:19.648147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:19.678209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-33bf3065-f2c1-4ae4-8a96-5e2048c18d6a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043752 May 12 21:11:19.678780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1068/2156] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:20.689533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:20.690549 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:20.700118 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:20.700561 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:20.701378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:20.701814 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:20.731725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5e3388e7-585b-46d9-a8bc-6ef8b7a93691 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046285 May 12 21:11:20.732277 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1089/2157] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:21.743673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:21.744594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:21.750991 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:21.751447 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:21.752219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:21.752668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:21.786481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7058de4b-6d73-4ec3-9b70-d8f05a603754 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046789 May 12 21:11:21.787049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1069/2158] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:22.802246 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:22.803176 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:22.809585 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:22.810039 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:22.810798 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:22.811233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:22.841888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8ea08e56-6ace-4a1f-86f9-e013b451ff5b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043565 May 12 21:11:22.842443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1090/2159] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:23.853831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:23.854751 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:23.861404 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:23.862717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:23.863539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:23.863972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:23.895579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-85df4bcf-08de-47de-b1db-6994fd6cb03b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045934 May 12 21:11:23.896143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1070/2160] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:24.907407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:24.908331 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:24.914782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:24.915245 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:24.916017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:24.916459 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:24.947251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8ff2bafd-39b8-4c35-9906-7c01a55e6c24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043873 May 12 21:11:24.947811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1091/2161] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:25.959356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:25.960275 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:25.966632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:25.967079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:25.967841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:25.968273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:25.998201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-07309a9d-4487-4c70-9e2f-2fdc66133d90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043143 May 12 21:11:25.998748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1071/2162] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:27.010241 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:27.011199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:27.017790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:27.018251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:27.019179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:27.019633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:27.048703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4aed82c9-5788-461b-a3dd-5e0e215825bf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042415 May 12 21:11:27.049256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1092/2163] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:11:27.427340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:11:27.427616 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:11:28.060828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:28.062058 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:28.068911 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:28.069391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:28.070158 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:28.070594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:28.099814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d3a7a6c3-eb06-4f3b-aa17-2e62194680b6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042924 May 12 21:11:28.100363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1072/2164] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:29.110763 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:29.111688 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:29.118134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:29.118522 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:29.119284 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:29.119717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:29.150752 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-606b0d56-0d89-4785-915c-be5e4ab8182a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043863 May 12 21:11:29.151329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1093/2165] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:30.163856 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:30.164791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:30.176419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:30.176419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:30.176419 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:30.176781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:30.212925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-df8e78cb-4209-488f-baf9-5335f775276d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053928 May 12 21:11:30.213566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1073/2166] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:31.225696 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:31.226600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:31.233014 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:31.233518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:31.234278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:31.234712 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:31.265556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-525dc1bc-9cf5-4197-baea-e91fc258c66c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045080 May 12 21:11:31.266122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1094/2167] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:32.277558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:32.278481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:32.285264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:32.285779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:32.286755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:32.287075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:32.317164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aa1a290d-74f2-490c-a641-4574d1313bc7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043587 May 12 21:11:32.317761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1074/2168] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:32.404279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:11:32.404474 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:11:33.328992 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:33.329897 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:33.336419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:33.336877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:33.337674 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:33.338119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:33.368313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4540d037-37ae-4860-bb82-5c0e3fbe5353 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043325 May 12 21:11:33.368872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1095/2169] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:34.380038 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:34.380944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:34.387296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:34.387743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:34.388493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:34.388923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:34.418705 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3aae02d7-b0f9-471c-b930-d737193f4d74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043398 May 12 21:11:34.419269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1075/2170] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:11:35.431884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:35.432813 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:35.439505 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:35.439966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:35.440751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:35.441415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:35.471884 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-cb1657a2-bf0d-493f-ab79-ace2d1e5cce1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044112 May 12 21:11:35.473097 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1096/2171] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:36.484223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:36.485148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:36.491852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:36.492307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:36.493064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:36.493528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:36.523540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-af28f108-c5b8-4db4-a24f-ca4f4aadfdc2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043308 May 12 21:11:36.524102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1076/2172] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:37.535953 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:37.536910 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:37.543484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:37.543935 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:37.544707 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:37.545145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:37.575790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-509826db-4ac4-46d8-8d46-fb0d656d4e53 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044632 May 12 21:11:37.576360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1097/2173] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:38.587776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:38.588693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:38.595117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:38.595573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:38.596333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:38.596766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:38.630154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-61a7ef9f-1eb0-48f1-a853-8bc7ef7f84a5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046269 May 12 21:11:38.630677 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1077/2174] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:39.642107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:39.643067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:39.649483 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:39.649937 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:39.650700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:39.651141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:39.681446 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0acfe2c8-ae37-42c8-be00-0e7bac3aef2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043477 May 12 21:11:39.689205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1098/2175] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:40.699508 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:40.700467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:40.706853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:40.707301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:40.708719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:40.709297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:40.738190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e3cbae45-9092-4c20-8198-00d49e79d301 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042749 May 12 21:11:40.738742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1078/2176] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:41.750042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:41.750966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:41.758184 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:41.758631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:41.759387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:41.759818 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:41.789775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-95864385-2c48-402e-b29a-77cd286f7c1d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043647 May 12 21:11:41.790322 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1099/2177] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:42.801342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:42.803214 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:42.809472 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:42.809921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:42.810674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:42.811103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:42.841131 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e2a46786-9902-46fa-85a1-11cca19075a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043707 May 12 21:11:42.841702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1079/2178] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:43.852214 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:43.853137 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:43.859576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:43.860036 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:43.860807 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:43.861455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:43.891540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-de4b95e0-37cf-4c6a-8859-8481758807e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043457 May 12 21:11:43.892127 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1100/2179] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:44.904255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:44.905182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:44.912172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:44.912649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:44.913454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:44.913895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:44.943630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9750401d-d002-4308-9133-de7927a5d0f5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043331 May 12 21:11:44.944176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1080/2180] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:45.955217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:45.956145 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:45.963297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:45.963754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:45.964526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:45.964963 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:46.002872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-be23ec5c-3233-4b0e-9227-21dddfbe19bd tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051565 May 12 21:11:46.003434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1101/2181] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:47.014139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:47.015327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:47.022136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:47.023011 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:47.023371 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:47.023803 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:47.054587 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d55fc23f-a1b9-44ec-b360-35316c6e48d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044397 May 12 21:11:47.055141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1081/2182] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:48.066462 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:48.067966 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:48.075115 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:48.075602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:48.076373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:48.076804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:48.105622 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ab9e9ffe-876a-46e6-8bb5-20296b993800 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043167 May 12 21:11:48.106178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1102/2183] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:49.117927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:49.118759 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:49.125019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:49.125512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:49.126267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:49.126702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:49.155672 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-765a018b-14c2-4b6a-81d3-cd7571976a33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042403 May 12 21:11:49.156221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1082/2184] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:50.168267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:50.169133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:50.175276 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:50.175729 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:50.176518 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:50.176965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:50.210418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9e6c6f35-5ce3-44ad-99a4-7825fcc8112f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046014 May 12 21:11:50.211469 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1103/2185] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:51.222979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:51.224350 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:51.230748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:51.231202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:51.231962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:51.232401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:51.262069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e2521ed8-a582-47a4-8a7b-ee411176ef49 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043071 May 12 21:11:51.262621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1083/2186] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:52.274996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:52.275817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:52.282114 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:52.282562 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:52.283313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:52.283745 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:52.314421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3f91c246-6ec5-44a4-8a98-2fd6e6f33070 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044357 May 12 21:11:52.314968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1104/2187] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:53.327814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:53.328661 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:53.335805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:53.336265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:53.337026 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:53.337532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:53.367341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-498710b1-687f-4d05-878a-787b3d006046 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043607 May 12 21:11:53.367897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1084/2188] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:54.379171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:54.380196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:54.386519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:54.386974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:54.387742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:54.388184 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:54.418049 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6dd36451-67ea-48b5-8c3b-e540872b188d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042940 May 12 21:11:54.418599 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1105/2189] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:55.432985 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:55.433933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:55.440297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:55.440748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:55.441534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:55.441973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:55.472415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8e6d6bc0-d53c-4766-828c-106a0a090381 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046631 May 12 21:11:55.472969 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1085/2190] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:56.484096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:56.485020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:56.492053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:56.492503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:56.493265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:56.493722 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:56.522300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3d0116a2-b739-4be4-a679-6e8a25fd6a28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042170 May 12 21:11:56.522856 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1106/2191] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:57.533862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:57.534815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:57.541116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:57.541600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:57.542358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:57.542798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:57.572988 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ad027cc1-abd3-4067-87a5-6c07983b4688 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043041 May 12 21:11:57.573566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1086/2192] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:58.584993 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:58.585948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:58.592278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:58.592734 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:58.593526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:58.593967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:58.624190 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7d7a2135-6b14-47ba-be76-b24a0807b870 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043866 May 12 21:11:58.624754 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1107/2193] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:11:59.636247 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:11:59.637173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:11:59.644023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:59.644485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:59.645345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:11:59.645815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:11:59.677814 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d873a9b6-c58f-4664-b09d-452a9577ab20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044546 May 12 21:11:59.681674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1087/2194] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:11:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:00.689309 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:00.690235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:00.697370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:00.697830 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:00.698604 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:00.699046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:00.728327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d7983613-3e1f-439d-8c8c-b0b374483c82 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043083 May 12 21:12:00.728880 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1108/2195] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:01.741066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:01.742013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:01.748256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:01.748703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:01.749494 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:01.749925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:01.779894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a18912a0-d418-4414-9bfd-9287e0a7f333 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043834 May 12 21:12:01.780445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1088/2196] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:02.791859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:02.792779 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:02.800141 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:02.800596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:02.801389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:02.802529 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:02.832231 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2fcccdfe-b04a-447f-9ab8-aaef86aecd08 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044315 May 12 21:12:02.832810 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1109/2197] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:03.844028 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:03.844939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:03.852092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:03.852538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:03.853312 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:03.853752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:03.884120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-72325a8c-bb7c-49c7-bb27-c7f28ddc4868 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044046 May 12 21:12:03.884671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1089/2198] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:04.896848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:04.897805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:04.904367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:04.904826 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:04.905630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:04.906075 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:04.935460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14dc3e32-215e-43dd-b1a0-0bb37fbe18a0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043304 May 12 21:12:04.936020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1110/2199] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:05.947728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:05.948668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:05.954977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:05.955425 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:05.956177 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:05.956610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:05.985435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60b926bc-dd6b-4dce-82cc-99b315bfb8fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041650 May 12 21:12:05.985980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1090/2200] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:06.996994 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:06.997939 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:07.004249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:07.004704 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:07.006051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:07.006493 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:07.035928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bc85554a-2350-448f-bd2d-7ad1219e2748 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042912 May 12 21:12:07.036533 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1111/2201] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:08.047738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:08.048659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:08.055876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:08.056327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:08.057094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:08.057567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:08.088313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-57ee4523-aed9-4223-8fdb-be7bdfb1bd34 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044427 May 12 21:12:08.089339 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1091/2202] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:09.100487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:09.101455 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:09.107782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:09.108228 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:09.108980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:09.109442 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:09.139019 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2e4d4685-a5a4-417d-9155-c14fba0f4b4a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042510 May 12 21:12:09.139489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1112/2203] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:10.151105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:10.152023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:10.158322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:10.158768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:10.159513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:10.159944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:10.189023 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5678218c-067b-4510-94a7-97bb89a658e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042843 May 12 21:12:10.189617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1092/2204] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:11.200251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:11.201081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:11.207644 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:11.208087 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:11.208845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:11.209843 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:11.238949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6bd28bce-529c-431f-842f-02df980530a9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042764 May 12 21:12:11.239494 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1113/2205] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:12.250865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:12.251694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:12.259153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:12.259598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:12.260358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:12.260789 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:12.292161 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-98cb9b74-b54f-40c6-8ee9-df2fe9a2e5a3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045303 May 12 21:12:12.292712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1093/2206] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:13.304026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:13.304978 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:13.311374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:13.311825 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:13.312584 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:13.313020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:13.345035 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-358c34a0-0600-4652-83f4-0f346acf7c94 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045011 May 12 21:12:13.345701 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1114/2207] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:14.357433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:14.358357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:14.364318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:14.364771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:14.365699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:14.366229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:14.398195 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6a150c4a-0f56-4ca3-ac4d-225d961f5a42 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044876 May 12 21:12:14.398758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1094/2208] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:15.409948 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:15.410872 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:15.417781 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:15.418233 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:15.418990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:15.419425 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:15.448606 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fb56bf6b-5a69-407a-8943-c2979a1691cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042582 May 12 21:12:15.449162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1115/2209] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:16.460442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:16.461379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:16.468000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:16.468484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:16.469253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:16.469846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:16.499152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-256c35f3-4d4a-4763-bc68-916e952c2c59 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042944 May 12 21:12:16.499704 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1095/2210] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:17.511859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:17.512774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:17.519680 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:17.520125 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:17.520879 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:17.521329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:17.551796 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2f62c535-5e46-4112-88dc-0b6fb3994652 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043922 May 12 21:12:17.552352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1116/2211] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:18.563563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:18.564391 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:18.571534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:18.571981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:18.572734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:18.573166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:18.602017 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8bf7237a-4603-4da0-ba98-e556fd5d821e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042502 May 12 21:12:18.602564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1096/2212] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:19.614313 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:19.615232 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:19.622138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:19.622582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:19.623333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:19.623759 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:19.654589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-246af3a9-3fd5-43d7-98d5-c55420f28e6d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044284 May 12 21:12:19.655135 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1117/2213] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:20.666726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:20.667684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:20.674051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:20.674510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:20.675267 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:20.675711 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:20.704978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99008308-a9ee-45a9-b72b-0a92c0e0f257 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042668 May 12 21:12:20.705567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1097/2214] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:21.716727 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:21.717683 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:21.723685 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:21.724139 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:21.725133 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:21.725511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:21.754750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8cdc37d6-d983-490b-b321-f9428392fd28 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042042 May 12 21:12:21.755305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1118/2215] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:22.766427 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:22.767347 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:22.774095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:22.774547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:22.775307 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:22.775741 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:22.806678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-31630088-cb81-44f0-9f4f-ac066773b5dc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044438 May 12 21:12:22.807236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1098/2216] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:23.818297 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:23.820344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:23.826657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:23.827106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:23.827858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:23.828293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:23.857581 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8a730d8d-365e-4141-a2f7-fe300a0f3ef3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043161 May 12 21:12:23.858143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1119/2217] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:24.869482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:24.870398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:24.876703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:24.877147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:24.877936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:24.878366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:24.913552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-08579dfe-8e1d-472d-8c3a-e0c6e24a2415 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048453 May 12 21:12:24.914119 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1099/2218] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:25.926357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:25.927326 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:25.934946 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:25.935395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:25.936199 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:25.936645 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:25.966974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7790e061-688c-473d-ae75-865cc1ef2007 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045771 May 12 21:12:25.972509 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1120/2219] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:12:26.978678 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:26.979594 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:26.985935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:26.986384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:26.987163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:26.987600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:27.018290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8240836c-0d07-4b4b-adc7-28d5186a8792 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043645 May 12 21:12:27.018848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1100/2220] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:28.030615 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:28.031541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:28.038438 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:28.038887 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:28.039650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:28.040089 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:28.070765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9e15b11c-f12c-4bf2-8b0e-68021f20ae45 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044050 May 12 21:12:28.071323 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1121/2221] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:29.081530 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:29.082444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:29.089695 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:29.090146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:29.090895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:29.091328 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:29.120854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4dddcf55-6b8c-4a44-869c-036923fca42f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043216 May 12 21:12:29.121340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1101/2222] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:30.132768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:30.133627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:30.140204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:30.140655 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:30.141721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:30.142156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:30.171384 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f5ad3cc9-f19c-4b8c-8ef0-9170c9a3c5ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043163 May 12 21:12:30.171944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1122/2223] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:31.183305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:31.184139 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:31.190698 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:31.191150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:31.191913 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:31.192351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:31.226171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c5b08aca-bfde-47e7-b641-3fb1125c814c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046900 May 12 21:12:31.226720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1102/2224] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:32.240947 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:32.241928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:32.248196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:32.248641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:32.249447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:32.249895 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:32.280689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3de2ccd8-9db4-4fb5-8865-5097a57b047e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044815 May 12 21:12:32.281258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1123/2225] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:33.292601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:33.293487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:33.299732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:33.300175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:33.300922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:33.301384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:33.331375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9692a18a-76ad-4bc2-b9cf-7fce67233d9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042881 May 12 21:12:33.331924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1103/2226] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:34.343413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:34.344367 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:34.351414 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:34.351898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:34.352664 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:34.353104 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:34.382017 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9f539b4b-53ee-4e71-a8e1-624c5a3a29c2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042746 May 12 21:12:34.382556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1124/2227] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:35.394253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:35.395194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:35.401783 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:35.402221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:35.402977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:35.403408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:35.433536 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4810f73b-fded-42dd-9c51-0b60ce6e8c09 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043801 May 12 21:12:35.434080 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1104/2228] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:36.446218 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:36.447129 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:36.453567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:36.454078 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:36.454848 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:36.455278 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:36.484603 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f9d00078-19d1-4a52-bb7c-cc75997f1267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043033 May 12 21:12:36.485167 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1125/2229] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:37.497301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:37.498223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:37.504671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:37.505118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:37.506771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:37.507384 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:37.537112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8b678f3c-11d0-4b54-ae19-5cbd2d21b1db tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043800 May 12 21:12:37.537702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1105/2230] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:38.551073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:38.551911 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:38.558426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:38.558883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:38.559639 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:38.560074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:38.590359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-598bfc8a-6cca-47d3-b44d-6eddf4df65c9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043354 May 12 21:12:38.590924 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1126/2231] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:39.602345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:39.603295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:39.609597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:39.610045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:39.610955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:39.611392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:39.641523 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-844a0718-c1ff-4b6f-a604-d0bec192e8d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043132 May 12 21:12:39.642152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1106/2232] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:40.653928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:40.654841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:40.661357 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:40.661815 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:40.662832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:40.663265 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:40.691811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-df89873f-1e46-498f-8494-3223025f2c20 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041868 May 12 21:12:40.692363 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1127/2233] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:41.704487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:41.705440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:41.712592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:41.713035 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:41.713815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:41.714248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:41.744084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99bf279c-5bb8-43fc-8a4d-01582becac8c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043490 May 12 21:12:41.744640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1107/2234] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:42.756702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:42.757670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:42.764319 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:42.764765 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:42.765555 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:42.765984 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:42.796108 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3f390ab2-06cd-489f-857d-01749b800b52 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044304 May 12 21:12:42.796679 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1128/2235] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:43.808189 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:43.809110 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:43.815111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:43.815570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:43.816333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:43.816778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:43.847782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5c4031c9-d3aa-497f-bb6f-75ae695d035e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043835 May 12 21:12:43.848344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1108/2236] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:44.859179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:44.860106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:44.867525 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:44.867980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:44.868751 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:44.869188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:44.898668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-af540ce0-3fff-45ad-a9ab-d07629e2d4b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043466 May 12 21:12:44.899230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1129/2237] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:45.910342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:45.911285 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:45.918370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:45.920774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:45.920774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:45.920774 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:45.950429 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-61ee5dad-56ee-448e-b587-883dbbbc0b48 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044113 May 12 21:12:45.950994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1109/2238] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:46.962523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:46.963378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:46.970030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:46.970479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:46.971239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:46.971705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:47.002253 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c038d5da-dc21-4237-901f-ae13ebf38db7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043955 May 12 21:12:47.002801 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1130/2239] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:48.014406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:48.015354 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:48.022468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:48.022919 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:48.023675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:48.024116 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:48.054086 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-49e93120-91d9-4961-9484-9dca35fb58b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043579 May 12 21:12:48.054636 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1110/2240] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:49.066250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:49.067204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:49.074069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:49.074521 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:49.075280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:49.075717 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:49.105460 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-daf0efdf-1af0-4487-b91b-ed328318c5a7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043102 May 12 21:12:49.106008 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1131/2241] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:50.117564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:50.118385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:50.124687 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:50.125132 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:50.125922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:50.126359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:50.157679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-10ef3cfa-09d5-4d8c-99fa-4d7616ade5e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045156 May 12 21:12:50.158240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1111/2242] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:51.169670 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:51.170508 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:51.176647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:51.177100 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:51.177929 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:51.178371 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:51.207703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6d77d595-b5a0-4fef-9595-268835785804 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042153 May 12 21:12:51.208267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1132/2243] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:52.220296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:52.221137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:52.228331 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:52.228785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:52.229580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:52.230018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:52.259675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f3017702-3422-4833-ab8e-b1d871f23178 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043398 May 12 21:12:52.260225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1112/2244] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:53.271710 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:53.272539 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:53.278862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:53.279308 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:53.280060 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:53.280488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:53.309583 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9af3efd9-9bc3-4654-b75f-5d1a4655f67b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041875 May 12 21:12:53.310151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1133/2245] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:54.321922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:54.322761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:54.329330 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:54.330276 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:54.330539 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:54.330980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:54.366520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5aa5bed8-74f7-431c-92f3-61fd995c32f0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049297 May 12 21:12:54.367093 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1113/2246] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:55.378611 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:55.379526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:55.385968 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:55.386352 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:55.387122 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:55.387552 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:55.418677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a9b0fe49-3c2d-43cb-bd0c-743a4eb59730 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044260 May 12 21:12:55.419227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1134/2247] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:56.430915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:56.431867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:56.438203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:56.438654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:56.439415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:56.439850 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:56.470168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d6443188-f670-4fa0-b66e-02bc2ad56d04 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043482 May 12 21:12:56.470714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1114/2248] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:57.482365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:57.483296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:57.489625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:57.490899 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:57.491735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:57.492169 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:57.522489 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6e5dad8b-1018-4e9b-b8d5-e61002db10e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043952 May 12 21:12:57.523281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1135/2249] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:58.534459 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:58.535410 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:58.546293 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:58.546746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:58.547518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:58.547952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:58.578049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-436ffa0c-0c58-43be-8c28-7c0420af3cec tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047529 May 12 21:12:58.578646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1115/2250] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:12:59.590370 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:12:59.591302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:12:59.597930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:59.598374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:59.599682 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:12:59.600151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:12:59.629933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-d5fbc73e-9a97-412c-8b9a-e953149ec86d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043496 May 12 21:12:59.630512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1136/2251] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:12:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:00.641683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:00.642784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:00.650475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:00.651064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:00.651900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:00.652334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:00.683359 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-def4ed1f-ab9c-4e4d-a1a0-262c9033b5cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046332 May 12 21:13:00.683927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1116/2252] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:01.560893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:13:01.561173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:13:01.695662 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:01.696590 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:01.702926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:01.703378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:01.704138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:01.704576 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:01.733790 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-41ba2f21-84f7-4884-84c9-b4378a92462c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042783 May 12 21:13:01.734340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1137/2253] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:02.746560 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:02.747397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:02.753898 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:02.754343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:02.755091 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:02.755522 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:02.786032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ddc37c90-69ac-4e5c-8c41-b30bdea4c9d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043560 May 12 21:13:02.786573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1117/2254] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:03.798703 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:03.799548 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:03.806962 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:03.807417 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:03.808183 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:03.808625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:03.838063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-c029eebc-9462-4b01-b5f2-a787b929eccc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043461 May 12 21:13:03.838625 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1138/2255] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:13:04.850370 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:04.851320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:04.857670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:04.858121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:04.858883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:04.859319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:04.889037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-106abbc5-21e9-4c6c-bae9-d0f810d6cf33 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043173 May 12 21:13:04.889629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1118/2256] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:05.900196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:05.901229 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:05.907663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:05.912647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:05.912647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:05.912647 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:05.940243 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-e2496b2c-fb41-43e7-b0dd-8859ff2ef1fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044031 May 12 21:13:05.944086 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1139/2257] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:06.952314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:06.953412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:06.959682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:06.960190 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:06.961345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:06.961788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:06.990712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-311b38a5-4292-452e-a9a1-a91e4060c13e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042444 May 12 21:13:06.991248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1119/2258] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:08.003174 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:08.004107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:08.011650 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:08.012111 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:08.012876 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:08.013341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:08.042980 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f3a54b66-b1d4-41a3-addb-c77b73ebb24f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043730 May 12 21:13:08.043540 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1140/2259] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:09.055087 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:09.056001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:09.062345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:09.062790 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:09.063547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:09.063981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:09.093257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3357875e-d88c-4f75-aaf3-cb917b46ad18 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042236 May 12 21:13:09.093866 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1120/2260] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:10.104940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:10.105882 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:10.112222 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:10.112668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:10.113637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:10.114124 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:10.144156 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-23d6c587-9165-4812-9949-06e6f292a67f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043940 May 12 21:13:10.144700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1141/2261] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:11.156418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:11.157277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:11.164134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:11.164583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:11.165364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:11.165802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:11.195706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a98f2e6c-e619-43cc-ba7c-60fd030678ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043341 May 12 21:13:11.196252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1121/2262] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:12.206878 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:12.207719 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:12.214281 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:12.214737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:12.215501 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:12.215943 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:12.245999 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f5778cb7-36df-4f73-a1c7-49505a252755 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043181 May 12 21:13:12.246559 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1142/2263] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:13.257639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:13.258673 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:13.264575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:13.265018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:13.265794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:13.266230 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:13.297489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-39fcd31e-853f-4eed-a435-144a8b4b25e8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044155 May 12 21:13:13.298034 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1122/2264] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:14.309567 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:14.310487 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:14.316861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:14.317374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:14.318166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:14.318595 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:14.349447 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0807a7b3-2255-465f-859c-f3dd39ba85ba tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044023 May 12 21:13:14.350084 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1143/2265] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:15.361639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:15.362554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:15.368984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:15.369463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:15.370225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:15.370658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:15.400402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c4d26a03-b52f-48ed-bbd1-92bf9b17db32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042780 May 12 21:13:15.400951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1123/2266] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:16.412251 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:16.413166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:16.420424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:16.420817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:16.421592 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:16.422025 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:16.455451 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4897beac-f733-40dc-a55f-65b2939711fe tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047120 May 12 21:13:16.456001 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1144/2267] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:17.467085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:17.468118 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:17.474518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:17.479320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:17.479320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:17.479320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:17.507402 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e5878640-4b48-4be3-a40b-4a7257ef84d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044160 May 12 21:13:17.507874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1124/2268] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:13:18.519940 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:18.520774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:18.527140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:18.527591 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:18.528350 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:18.528786 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:18.558871 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fae4bb49-48f2-4d70-b4ea-5bfc94554b76 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043236 May 12 21:13:18.559433 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1145/2269] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:19.570295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:19.571834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:19.578143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:19.578599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:19.579355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:19.579792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:19.609574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e180a591-e01b-43df-8532-81f86f7e5df6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043184 May 12 21:13:19.610127 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1125/2270] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:20.621930 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:20.622757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:20.628700 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:20.629149 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:20.629945 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:20.630388 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:20.659753 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-b0e08787-a2e3-4ca9-9f29-f772af28e8d3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042437 May 12 21:13:20.660307 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1146/2271] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:21.644894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:13:21.645514 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:13:21.671717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:21.672638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:21.679069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:21.679518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:21.680907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:21.681387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:21.710068 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9ed7320a-e8ad-4930-a1cf-af8da05db361 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042249 May 12 21:13:21.710614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1126/2272] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:22.722061 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:22.722893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:22.729556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:22.730005 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:22.730764 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:22.731198 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:22.762046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-44e9fc04-2fec-4942-88bc-7bdac91fb88c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043981 May 12 21:13:22.762600 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1147/2273] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:23.774842 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:23.775764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:23.782032 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:23.782480 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:23.783227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:23.783824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:23.811906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0935ae3b-c1b5-4d62-9619-aae9f151ad47 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041691 May 12 21:13:23.812648 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1127/2274] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:13:24.823693 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:24.824538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:24.830888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:24.831340 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:24.832096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:24.832553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:24.862770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5112661a-a955-4d0e-a1be-59ad610522f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043117 May 12 21:13:24.864972 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1148/2275] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:25.876355 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:25.877300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:25.884250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:25.884700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:25.885498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:25.885938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:25.915288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b8ee72e0-e0e7-4c64-a871-abc4ff3b3770 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043215 May 12 21:13:25.920394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1128/2276] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:26.928126 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:26.929041 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:26.936440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:26.936886 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:26.937767 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:26.938201 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:26.967426 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-700d6603-0555-4106-bbe4-4883bb676d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043231 May 12 21:13:26.967974 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1149/2277] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:27.979395 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:27.980318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:27.986640 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:27.987111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:27.987854 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:27.988291 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:28.018264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fc27a351-7881-46c0-9313-737fc755d9a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042892 May 12 21:13:28.018811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1129/2278] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:29.029996 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:29.030921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:29.037267 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:29.037755 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:29.038523 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:29.038965 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:29.069334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-94ee23b0-b3d5-4053-9c75-691d58d0c9ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043282 May 12 21:13:29.069896 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1150/2279] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:30.081764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:30.082614 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:30.089059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:30.089552 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:30.090310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:30.090746 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:30.119518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7aa9dd03-a678-428c-bdf3-039d0e121994 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041808 May 12 21:13:30.120060 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1130/2280] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:30.759213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:13:30.759864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:13:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:13:31.131134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:31.132069 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:31.138602 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:31.139056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:31.139817 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:31.140254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:31.172030 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-6f5ef147-6ef0-4e4c-afa8-badbc711f2e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044834 May 12 21:13:31.172582 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1151/2281] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:32.183785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:32.184617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:32.194537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:32.194990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:32.196274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:32.196744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:32.227637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cfec8386-a358-4c36-890e-21320387702a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047425 May 12 21:13:32.228238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1131/2282] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:33.239471 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:33.240395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:33.246728 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:33.247188 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:33.247964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:33.248389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:33.277933 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8c570080-6d73-436e-a91d-a9835cfdd264 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042454 May 12 21:13:33.278511 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1152/2283] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:34.290210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:34.291226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:34.297531 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:34.297982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:34.298752 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:34.299220 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:34.329353 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8b5bf21b-8e14-4c72-9a5a-bc6afc5e922f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043656 May 12 21:13:34.329900 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1132/2284] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:35.341152 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:35.342102 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:35.348514 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:35.348967 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:35.349757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:35.350193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:35.379298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-5f936b42-ac8a-459e-bbc9-12ba0a07a201 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042236 May 12 21:13:35.379841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1153/2285] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:36.390903 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:36.391853 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:36.398400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:36.398910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:36.400022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:36.400466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:36.429941 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a183c171-5d62-4ed9-ae49-ff2b5affdd9c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042985 May 12 21:13:36.431439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1133/2286] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:37.443238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:37.444192 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:37.450927 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:37.451378 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:37.452136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:37.452571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:37.482196 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0edf0995-2b2e-428e-a385-a851ad85a8bc tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042998 May 12 21:13:37.482756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1154/2287] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:38.496378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:38.497987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:38.508052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:38.508491 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:38.509378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:38.510492 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:38.540962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a7f55f0d-a47a-4227-9056-c9026f1119eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050908 May 12 21:13:38.541608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1134/2288] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:39.551866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:39.552822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:39.559140 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:39.559596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:39.560356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:39.560791 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:39.591180 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1c71fc5e-e438-4f73-8fde-076a50620d9b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043238 May 12 21:13:39.591757 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1155/2289] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:40.602875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:40.604444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:40.610950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:40.611334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:40.612095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:40.612532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:40.641174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cae70097-3449-48cb-839d-d8c01a1f80d5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042290 May 12 21:13:40.641845 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1135/2290] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:41.653828 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:41.654749 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:41.661641 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:41.662096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:41.662853 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:41.663290 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:41.692159 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3d2081bf-3bfc-401e-b3c7-04a240243e2c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042910 May 12 21:13:41.692705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1156/2291] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:42.704317 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:42.705171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:42.711424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:42.711871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:42.713136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:42.713603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:42.742772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d5599dfd-3f56-45ee-8ddc-557f0b1e1f2a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042579 May 12 21:13:42.743314 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1136/2292] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:43.755413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:43.756325 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:43.762916 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:43.763360 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:43.764106 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:43.764536 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:43.795705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-46ed33cb-ca6d-4971-a500-344a3610cb90 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044349 May 12 21:13:43.796260 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1157/2293] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:44.808341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:44.809296 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:44.815264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:44.815717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:44.816477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:44.816912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:44.850041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-26edd24e-866f-4490-a93b-23954769b27c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046452 May 12 21:13:44.850601 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1137/2294] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:45.862194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:45.869480 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:45.870420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:45.870868 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:45.871629 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:45.872073 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:45.902942 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-bb128194-3eb8-4702-84ec-3cb5a88a5c2b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044776 May 12 21:13:45.903526 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1158/2295] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:45 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:46.914691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:46.916170 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:46.922992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:46.924499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:46.924499 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:46.924733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:46.954518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c1b2fb12-b002-4693-962a-cd3e2bf4ad8f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043895 May 12 21:13:46.955069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1138/2296] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:47.967601 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:47.968519 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:47.974775 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:47.975225 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:47.975971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:47.976404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:48.005620 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f433fd5c-2502-40f3-acb0-eea404cd870e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042924 May 12 21:13:48.006163 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1159/2297] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:49.017646 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:49.018871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:49.025864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:49.026316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:49.027098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:49.027532 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:49.056702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-540749b6-7c5c-441d-ab44-c6ee88940f0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043002 May 12 21:13:49.057240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1139/2298] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:50.068467 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:50.069419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:50.076827 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:50.077306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:50.078071 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:50.078503 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:50.112486 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8fc64740-9ec1-40ee-91cf-3e6be2493e00 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047973 May 12 21:13:50.113053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1160/2299] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:51.124859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:51.125753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:51.132114 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:51.132570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:51.133362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:51.133815 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:51.163416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ebfbce6c-d3fb-4ec0-9179-cf40feaa9ed4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042578 May 12 21:13:51.163980 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1140/2300] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:52.175466 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:52.176359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:52.183215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:52.183663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:52.184458 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:52.184891 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:52.215063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-68196ad8-cf7b-49b9-8e3f-425abcb184d7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043601 May 12 21:13:52.215618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1161/2301] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:53.226394 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:53.227228 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:53.234707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:53.235154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:53.235910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:53.236344 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:53.266239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4d2ffe87-b038-4c3b-8a4b-c3acd0f65030 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043980 May 12 21:13:53.266785 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1141/2302] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:54.278476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:54.279314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:54.285725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:54.286186 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:54.286952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:54.287393 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:54.317421 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-654d6711-7c13-4412-88a6-30ff6f40af91 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043050 May 12 21:13:54.317988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1162/2303] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:55.329475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:55.330342 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:55.336626 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:55.337076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:55.337863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:55.338306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:55.367564 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9d645e82-1356-4670-b690-f0ae13319306 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042204 May 12 21:13:55.368109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1142/2304] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:56.379332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:56.380258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:56.386587 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:56.387046 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:56.387804 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:56.388250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:56.418793 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ba8d7ceb-1bd7-4415-8527-365bf6e5c923 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042737 May 12 21:13:56.419359 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1163/2305] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:57.430602 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:57.431563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:57.438076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:57.438418 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:57.439172 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:57.439608 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:57.469583 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b377277a-a6e6-43d1-8ee8-a2d578229aa2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043010 May 12 21:13:57.470134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1143/2306] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:58.481227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:58.482288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:58.488702 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:58.489153 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:58.489949 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:58.490386 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:58.519295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-78c936e6-6f66-4b61-9fe9-bfb7f4af296b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042406 May 12 21:13:58.519849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1164/2307] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:13:59.531832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:13:59.532755 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:13:59.539264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:59.539717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:59.540476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:13:59.540912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:13:59.570793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3d2d438d-aa99-4991-8486-17c22e255afa tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043515 May 12 21:13:59.571467 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1144/2308] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:13:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:00.584098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:00.585027 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:00.596194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:00.596726 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:00.597845 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:00.598488 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:00.629731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-783fcd7f-ecd0-4cee-ba86-b3f80cc1cc0a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050851 May 12 21:14:00.630204 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1165/2309] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:14:01.642361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:01.643305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:01.649833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:01.650289 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:01.651040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:01.651471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:01.681690 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-664db69d-9cd0-45dc-9f85-f9a5ddc99912 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043223 May 12 21:14:01.682240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1145/2310] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:02.694500 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:02.695373 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:02.702652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:02.703110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:02.703874 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:02.704310 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:02.734333 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-0a5db371-0c94-43c3-9c74-1459353852ef tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043554 May 12 21:14:02.734637 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1166/2311] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:03.746334 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:03.747335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:03.753573 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:03.754020 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:03.754772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:03.755205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:03.785979 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-09f51904-beb9-4e7e-b497-56ccc3c88b36 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044086 May 12 21:14:03.786538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1146/2312] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:04.798256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:04.799093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:04.805420 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:04.805875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:04.806638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:04.807074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:04.837013 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2cc07a2c-59c2-43f3-9bff-915fb07d3d32 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042831 May 12 21:14:04.837593 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1167/2313] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:14:05.848621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:05.849582 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:05.855983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:05.856439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:05.857205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:05.857680 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:05.887728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99cc6c1c-8b37-4f7d-8c8c-068dfd35631f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043077 May 12 21:14:05.888278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1147/2314] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:05 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:06.905773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:06.906777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:06.913374 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:06.913822 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:06.914578 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:06.915007 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:06.945608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-286a1c2b-30cb-4555-8fb9-e377d237e02e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049694 May 12 21:14:06.946165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1168/2315] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:07.957694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:07.958622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:07.965121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:07.965604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:07.966375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:07.966818 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:07.996585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-add88872-d736-48c9-a993-dce02fc74d0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042230 May 12 21:14:07.997246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1148/2316] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:09.008302 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:09.009220 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:09.016419 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:09.016866 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:09.017643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:09.018079 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:09.047221 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9ee004d3-06cf-42c4-bca0-3e5b88c90a61 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042891 May 12 21:14:09.047770 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1169/2317] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:10.059696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:10.060618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:10.067218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:10.067670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:10.068435 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:10.068871 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:10.098108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eef2d9f8-d3e2-4489-a96d-a0a5aacd6f74 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042949 May 12 21:14:10.098657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1149/2318] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:11.109914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:11.110864 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:11.117237 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:11.117659 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:11.118443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:11.118888 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:11.154219 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-76c1bcb6-a91f-456b-ae81-8de3123efb7c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048124 May 12 21:14:11.155053 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1170/2319] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:12.165782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:12.166638 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:12.173684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:12.174164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:12.175300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:12.175438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:12.205171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ab3b1fcd-5fb4-498e-972f-28d4a0fc3a44 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043506 May 12 21:14:12.205775 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1150/2320] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:13.217194 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:13.225732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:13.225732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:13.225732 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:13.226107 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:13.226283 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:13.254961 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-fd43d285-354d-4da0-9777-d2dde45d7d98 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042603 May 12 21:14:13.255512 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1171/2321] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:14.267357 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:14.268282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:14.274603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:14.275062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:14.275827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:14.276269 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:14.305322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-ee3ba1c6-f179-4a6c-b057-b96989b8a7eb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041934 May 12 21:14:14.319809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1151/2322] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:15.317461 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:15.318377 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:15.325354 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:15.325805 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:15.326631 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:15.327067 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:15.357532 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1fcabdff-1731-4e48-9868-14661daa3cee tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043888 May 12 21:14:15.358088 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1172/2323] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:16.368489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:16.369442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:16.376322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:16.376778 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:16.377585 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:16.378146 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:16.410405 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2853f2cd-b83f-48c2-b0b5-9400107ba1c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045790 May 12 21:14:16.410974 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1152/2324] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:17.422975 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:17.423905 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:17.430258 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:17.430711 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:17.431479 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:17.431921 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:17.460579 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-08957a00-c84a-4a8b-ba29-dfdcb165a643 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042289 May 12 21:14:17.461158 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1173/2325] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:18.472192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:18.473104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:18.479385 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:18.479857 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:18.480617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:18.481050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:18.511283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d8020481-247b-4bc6-b899-ce0e07d53491 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043072 May 12 21:14:18.511828 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1153/2326] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:19.522432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:19.523344 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:19.529614 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:19.530063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:19.530816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:19.531242 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:19.561444 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-1e50e597-e6ea-490e-97e2-39b71999f562 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043131 May 12 21:14:19.562026 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1174/2327] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:20.573233 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:20.574169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:20.581641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:20.582089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:20.582843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:20.583278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:20.615823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a282ab12-6d0e-439b-8cd3-b0b57338b9b8 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046478 May 12 21:14:20.616439 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1154/2328] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:21.630058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:21.631300 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:21.638528 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:21.639015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:21.640544 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:21.640969 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:21.672657 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-78fb32ac-7c40-499f-bd12-39911c03067d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048674 May 12 21:14:21.673248 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1175/2329] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:22.684948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:22.685888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:22.698610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:22.698610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:22.698610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:22.698610 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:22.726029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9b092d5b-1ec8-4b90-8050-b01addd5718c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045191 May 12 21:14:22.726591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1155/2330] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:23.738413 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:23.739335 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:23.745690 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:23.746136 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:23.746894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:23.747328 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:23.776750 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-36215c00-7888-46fa-9007-cc9cd80a8dac tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042460 May 12 21:14:23.777389 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1176/2331] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:24.788912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:24.789794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:24.796937 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:24.797477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:24.798234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:24.798666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:24.827225 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9a4b97f3-0bd8-41fc-8793-8b43a27780e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042295 May 12 21:14:24.827794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1156/2332] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:25.838971 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:25.839893 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:25.846339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:25.846792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:25.847547 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:25.847983 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:25.878364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a228b7f7-3844-4c11-9060-e94e4a36bd80 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043368 May 12 21:14:25.878919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1177/2333] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:25 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:26.890348 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:26.891256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:26.897822 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:26.898266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:26.899010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:26.899438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:26.930505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a0522d1c-0f99-43e7-9bb0-a65f2c3c43f1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044179 May 12 21:14:26.931075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1157/2334] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:27.942638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:27.943554 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:27.949926 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:27.950654 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:27.951410 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:27.952643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:27.981862 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-91e2e3e1-a6d2-425d-ba49-1180efc851b5 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043211 May 12 21:14:27.982407 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1178/2335] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:28.993538 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:28.994457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:29.001428 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:29.001881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:29.002641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:29.003079 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:29.031915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c18570c2-af5c-43f8-802c-8158141e3cc1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042409 May 12 21:14:29.032453 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1158/2336] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:30.043668 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:30.044534 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:30.051678 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:30.052138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:30.052909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:30.053372 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:30.082096 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7cd63fe9-f4d9-4016-8ee0-d2f44e2077c3 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042495 May 12 21:14:30.082661 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1179/2337] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:30 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:31.325928 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:31.326876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:31.333756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:31.334218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:31.334984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:31.335420 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:31.365297 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-195f5085-e1cc-44b7-a0ad-fe208d46be88 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.276151 May 12 21:14:31.365852 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1159/2338] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:31 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:32.377944 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:32.378865 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:32.385395 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:32.385850 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:32.386618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:32.387054 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:32.416633 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3db69370-5227-430e-a70c-d129077b1a6c tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043268 May 12 21:14:32.417178 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1180/2339] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:33.428273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:33.429199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:33.435520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:33.435973 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:33.436734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:33.437179 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:33.466923 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d19f184b-a42d-41ee-9b50-5d37c8cc7133 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042657 May 12 21:14:33.467487 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1160/2340] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:34.479238 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:34.480166 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:34.487185 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:34.487638 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:34.488398 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:34.488832 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:34.517443 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-473ca5c5-d691-4360-af77-9fad75758ed0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042142 May 12 21:14:34.517990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1181/2341] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:35.529506 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:35.531136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:35.537591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:35.538048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:35.538813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:35.539254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:35.568633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-60442a1e-a0aa-4e47-9fdd-1e31aff58668 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043076 May 12 21:14:35.569203 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1161/2342] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:35 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:36.580892 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:36.581842 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:36.588119 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:36.588571 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:36.589356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:36.589797 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:36.618877 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-da54ace8-6caf-4785-b69b-fb89628c5645 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042562 May 12 21:14:36.619430 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1182/2343] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:37.631555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:37.632471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:37.638703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:37.639147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:37.640622 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:37.641310 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:37.678140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e5aed1ca-1782-4a11-9f6b-043e037d026f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050564 May 12 21:14:37.678717 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1162/2344] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:37 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:38.690721 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:38.691556 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:38.697869 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:38.698314 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:38.699059 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:38.699491 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:38.731399 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-2a61d8b4-2b0c-4b26-94b2-8416d682af22 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045212 May 12 21:14:38.731959 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1183/2345] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:38 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:39.743730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:39.744675 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:39.751662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:39.752107 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:39.752863 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:39.753313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:39.783963 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fa185bd8-0202-44ad-930f-9a3aad7b46ab tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044171 May 12 21:14:39.784851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1163/2346] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:40.795416 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:40.796249 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:40.802568 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:40.803020 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:40.803782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:40.804215 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:40.833928 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-8afc2606-8fd6-45bc-afa4-779196a6b44a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042567 May 12 21:14:40.834484 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1184/2347] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:40 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:41.846102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:41.847024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:41.853400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:41.853851 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:41.854603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:41.855036 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:41.885807 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5b9ae326-9769-4f0c-87d0-b2e3a9a36d62 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043801 May 12 21:14:41.886363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1164/2348] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:41 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:42.898187 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:42.899227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:42.905675 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:42.906130 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:42.906900 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:42.907334 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:42.936478 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-10b2d627-5353-4406-8091-619a34386411 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042717 May 12 21:14:42.937694 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1185/2349] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:42 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:43.949229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:43.950183 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:43.956542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:43.957005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:43.957800 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:43.958248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:43.987567 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-62a0b3c5-39a9-48b3-8c2a-8f5dc9466592 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042301 May 12 21:14:43.988130 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1165/2350] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:43 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:44.998669 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:45.000273 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:45.006589 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:45.007042 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:45.007799 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:45.008235 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:45.037608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-54f4f479-a73e-49b0-bf0c-18696d136017 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042912 May 12 21:14:45.038164 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1186/2351] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:44 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:46.049782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:46.050702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:46.056983 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:46.057475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:46.058227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:46.058662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:46.088875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1370f4c0-50c3-4664-a6d0-1375560f5590 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043628 May 12 21:14:46.089465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1166/2352] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:46 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:47.100230 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:47.101151 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:47.107513 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:47.107960 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:47.109327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:47.109792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:47.140121 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-f697a3dd-278f-4567-accf-c502338c08bb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043770 May 12 21:14:47.140739 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1187/2353] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:47 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:47.435789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:14:47.436024 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:14:48.151995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:48.152849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:48.159235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:48.159683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:48.160433 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:48.160870 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:48.189970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9e1add9a-0068-4d75-86c8-38f507142543 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041975 May 12 21:14:48.190513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1167/2354] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:48 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:49.201858 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:49.203418 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:49.212098 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:49.214919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:49.214919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:49.214919 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:49.248056 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-320c45de-0443-4d2f-924c-d1f5ad438745 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050318 May 12 21:14:49.248630 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1188/2355] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:49 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:50.260628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:50.261507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:50.268064 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:50.268510 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:50.269320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:50.269761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:50.300123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3e2f0dd4-6311-4b68-b875-2ef337bdc4f6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043450 May 12 21:14:50.300689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1168/2356] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:50 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:51.312689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:51.313564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:51.319564 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:51.320015 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:51.320784 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:51.321216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:51.350990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-325714c4-3556-407c-a4b3-36e7949b9d9f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042846 May 12 21:14:51.351550 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1189/2357] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:51 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:52.363700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:52.364635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:52.370932 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:52.371375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:52.372125 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:52.372559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:52.403882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4618de5d-cb7c-411b-9662-45568f6a1c58 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045166 May 12 21:14:52.404441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1169/2358] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:52 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:52.412408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:14:52.412570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:14:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:14:53.416182 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:53.417110 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:53.423922 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:53.424376 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:53.425143 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:53.425618 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:53.457256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4038ead2-2227-47f1-8f23-1e3733979e9e tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044956 May 12 21:14:53.457849 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1190/2359] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:53 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:54.470094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:54.471014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:54.477586 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:54.478043 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:54.478811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:54.479252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:54.508750 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a9fdd0ae-5c5f-4b4b-a9e2-2627b5dda018 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043356 May 12 21:14:54.509320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1170/2360] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:54 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:55.520914 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:55.521861 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:55.528254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:55.528705 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:55.529535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:55.529970 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:55.560834 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-3b8af0b4-394f-441a-ade5-7fc360296e77 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044085 May 12 21:14:55.561412 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1191/2361] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:55 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:14:56.572604 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:56.573606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:56.580016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:56.580483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:56.581215 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:56.581674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:56.610599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-abde47d8-f428-4f5d-b184-f2240dec6c75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041945 May 12 21:14:56.611150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1171/2362] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:56 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:57.622296 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:57.623217 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:57.630341 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:57.630792 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:57.631553 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:57.631995 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:57.662415 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-98c2c45c-42d2-4c0f-b0f0-8a42953bb455 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044140 May 12 21:14:57.662973 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1192/2363] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:57 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:58.674982 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:58.675817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:58.682163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:58.682615 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:58.683374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:58.683811 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:58.712468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-eeb3ca72-feec-458f-b941-447472c62400 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042283 May 12 21:14:58.713022 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1172/2364] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:58 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:14:59.724434 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:14:59.725409 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:14:59.731883 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:59.732531 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:59.733881 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:14:59.734306 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:14:59.764327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-42d4dbb0-5fbb-4789-9b70-9be155008d05 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044002 May 12 21:14:59.765128 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1193/2365] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:14:59 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:00.776466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:00.777318 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:00.784549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:00.785006 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:00.785794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:00.786235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:00.815603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c0d621b4-a310-4488-a6ab-5c1b674cce01 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043164 May 12 21:15:00.816152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1173/2366] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:00 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:01.828788 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:01.829725 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:01.837093 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:01.837566 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:01.838329 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:01.838768 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:01.869663 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a77e8cce-55dc-4f77-bf42-5eb4866f0204 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045290 May 12 21:15:01.870213 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1194/2367] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:01 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:02.881592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:02.882516 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:02.888813 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:02.889264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:02.890062 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:02.890495 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:02.921398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-844fc4ce-d77c-4156-8f06-8ec68863ba19 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043254 May 12 21:15:02.921986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1174/2368] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:02 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:03.933173 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:03.934138 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:03.941051 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:03.941538 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:03.942305 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:03.942742 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:03.972463 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-beb2b212-4551-43f6-8afb-95d4c3ab27a6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043260 May 12 21:15:03.973063 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1195/2369] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:03 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:04.984257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:04.985171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:04.991483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:04.991929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:04.992683 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:04.993265 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:05.022279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-db0fa0fb-7803-4c11-b0ad-cd852dbd0746 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042131 May 12 21:15:05.022827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1175/2370] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:04 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:06.034756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:06.035673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:06.042256 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:06.042737 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:06.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:06.046841 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:06.073656 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-dffa9bd2-dd7b-4ed9-9dfe-d103e5b1c7c1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043486 May 12 21:15:06.074209 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1196/2371] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:06 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:07.085306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:07.086239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:07.092470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:07.092924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:07.093702 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:07.094136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:07.123120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b97bf660-bc8e-4d76-a840-1254f03d3f24 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041692 May 12 21:15:07.123581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1176/2372] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:07 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:08.135327 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:08.136189 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:08.143332 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:08.143777 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:08.144535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:08.144964 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:08.173785 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-14c991e1-55d7-41d5-b04f-39a8f21447b2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042405 May 12 21:15:08.174347 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1197/2373] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:08 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:09.185518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:09.186343 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:09.192563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:09.193018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:09.193810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:09.194254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:09.223770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-32f5e917-8901-4311-ad57-62b3b2466f0b tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042513 May 12 21:15:09.224329 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1177/2374] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:09 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:10.236756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:10.237632 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:10.243998 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:10.244448 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:10.245206 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:10.245677 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:10.276050 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-47b1f9d7-51ae-40b5-9782-22d73e2d66d1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044539 May 12 21:15:10.276597 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1198/2375] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:10 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:11.287715 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:11.288542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:11.294912 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:11.295356 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:11.296104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:11.296794 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:11.328580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-db6ecafb-359b-44c3-93c0-0fe5ee508071 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044106 May 12 21:15:11.329156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1178/2376] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:11 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:12.341085 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:12.342095 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:12.349074 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:12.349570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:12.350337 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:12.350774 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:12.379652 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-acaea717-6f39-489c-840c-7569e471236a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042647 May 12 21:15:12.380203 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1199/2377] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:12 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:13.392666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:13.393529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:13.399714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:13.400157 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:13.400910 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:13.401374 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:13.430248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-475df3f7-d2aa-4a49-a29e-15a360415943 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042707 May 12 21:15:13.430797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1179/2378] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:13 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:14.442898 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:14.443816 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:14.450134 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:14.450586 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:14.451339 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:14.451773 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:14.482295 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-4ce95521-6eb1-45fb-b6cc-249dbb55b1e4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043316 May 12 21:15:14.482857 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1200/2379] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:14 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:15.495090 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:15.496012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:15.502505 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:15.502962 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:15.503723 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:15.504163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:15.535221 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4c8fe0d3-eb95-48ca-aa57-4f2819390cf1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044055 May 12 21:15:15.535998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1180/2380] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:15 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:16.547909 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:16.548894 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:16.555382 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:16.555831 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:16.556596 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:16.557029 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:16.586216 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-a4bd8c88-8149-49cf-97fb-0db9636b2f87 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042889 May 12 21:15:16.586811 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1201/2381] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:16 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:17.599254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:17.600166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:17.606712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:17.607173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:17.607938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:17.608379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:17.637463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c5e850a9-24aa-4af3-b4d6-7de9724380cb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042140 May 12 21:15:17.638015 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1181/2382] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:17 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:18.650440 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:18.651365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:18.658356 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:18.658808 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:18.659570 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:18.660058 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:18.689161 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-7a8324b1-92ce-4951-86b7-50dc61dd9430 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042666 May 12 21:15:18.689740 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1202/2383] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:18 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:19.700159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:19.701089 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:19.708208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:19.708667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:19.709475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:19.709917 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:19.739471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3432af3e-f5fd-49bb-a071-91d9985ee038 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043374 May 12 21:15:19.740027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1182/2384] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:19 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:20.751628 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:20.752465 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:20.758545 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:20.758997 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:20.759756 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:20.760193 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:20.789250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-42fd3363-f36d-48c9-b052-04af7083a9ce tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042444 May 12 21:15:20.789824 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1203/2385] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:20 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:21.800830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:21.801918 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:21.808238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:21.808691 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:21.809483 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:21.809924 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:21.839712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-84a0f51e-b4f3-4b67-8cac-73b4eae9bc75 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042880 May 12 21:15:21.840255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1183/2386] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:21 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:22.851365 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:22.852280 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:22.858535 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:22.858990 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:22.860387 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:22.860829 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:22.892608 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ec27f00f-ba1b-4a30-823a-78fcc3f5b99f tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045144 May 12 21:15:22.893162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1204/2387] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:22 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:23.904077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:23.904989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:23.912108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:23.912555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:23.913327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:23.913762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:23.945014 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d1063f74-f214-439d-970f-fa40f28496e2 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044836 May 12 21:15:23.945613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1184/2388] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:23 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:24.957298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:24.958288 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:24.964925 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:24.965404 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:24.966165 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:24.966606 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:24.996735 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9e8671d0-57c0-4f61-a591-762d96e44b72 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043946 May 12 21:15:24.997293 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1205/2389] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:24 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:26.010186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:26.011111 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:26.019806 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:26.020256 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:26.021295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:26.021735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:26.051182 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d4e4a6f8-af0c-412f-8ce0-02bddf20c177 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045402 May 12 21:15:26.051734 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1185/2390] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:26 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:27.062673 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:27.064349 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:27.071698 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:27.071859 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:27.076364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:27.076364 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:27.114476 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-9e606d68-685b-4220-b410-e30ff46b2adf tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055839 May 12 21:15:27.115298 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1206/2391] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:27 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:28.128255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:28.133862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:28.136100 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:28.136693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:28.137542 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:28.138045 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:28.168212 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-abf3bb7e-8d3e-4f0d-84ad-03b1c8e37b63 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045894 May 12 21:15:28.169112 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1186/2392] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:28 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:29.179646 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:15:29.180782 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129358) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:29.187162 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:29.187627 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:29.188543 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:29.189731 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:29.221474 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO nova.api.openstack.requestlog [None req-ef76a4d9-e71b-4592-9b7d-286cfd9da02a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045812 May 12 21:15:29.222044 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: [pid: 129358|app: 0|req: 1207/2393] 10.222.0.59 () {58 vars in 1301 bytes} [Thu May 12 21:15:29 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:15:30.233674 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:15:30.234906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:15:30.245426 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:30.246326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:30.247443 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:30.247952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:32.478995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a92beac6-afe9-4d12-b854-c1e2ff4565f9 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/action" status: 200 len: 41376 microversion: 2.1 time: 2.250398 May 12 21:15:32.480590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1187/2394] 10.222.0.59 () {60 vars in 1277 bytes} [Thu May 12 21:15:30 2022] POST /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335/action => generated 41376 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 21:15:33.442541 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.api.openstack.wsgi [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2062849592", "imageRef": "b74b8dde-8b59-46e7-89b5-77cdb4a31542", "flavorRef": "452", "networks": [{"uuid": "2668676a-64e2-42de-88a8-b3b6f4a5bc09"}]}} {{(pid=129358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:15:33.689081 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.network.neutron [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] validate_networks() for [('2668676a-64e2-42de-88a8-b3b6f4a5bc09', None, None, None, None, None)] {{(pid=129358) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 21:15:34.296368 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Flavor limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 21:15:34.296789 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Image limits 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 21:15:34.297254 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Flavor pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 21:15:34.299205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Image pref 0:0:0 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 21:15:34.299205 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.virt.hardware [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 21:15:34.307171 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:34.307610 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:34.308394 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:15:34.308821 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG oslo_concurrency.lockutils [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:15:34.325431 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Getting quotas for project fd3f403a1bdf48db8bec832b39b8f391. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 21:15:34.329255 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.quota [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Getting quotas for user b4df001beaca4de2a8e15c26b31a9168 and project fd3f403a1bdf48db8bec832b39b8f391. Resources: {'instances', 'ram', 'cores'} {{(pid=129358) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 21:15:34.339875 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] Going to run 1 instances... {{(pid=129358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 21:15:34.342179 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: DEBUG nova.compute.api [None req-14a0f44c-2af9-46d4-b947-eff545364b5f tempest-VolumesSnapshotTestJSON-1592398503 tempest-VolumesSnapshotTestJSON-1592398503-project] [instance: 4e373e80-1574-4c5f-9d39-283afa49103a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b74b8dde-8b59-46e7-89b5-77cdb4a31542',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 21:16:21.569251 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:16:21.569801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:16:50.767716 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:16:50.768369 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:17:25.409563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-09c32d58-fff6-42a2-8843-007b877379fc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Action: 'create', calling method: .version_select at 0x7f4e62e4fa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2084107512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdFyZhRtpu0r9A7C3Ndtocl/jv4IlmAP2YHjo2gjUJd3CCqatCG/oCA/qJyJ0q6k+kpEWSVyproX9azSIBjlyp9eMKw4474X5q8JOksUpSGCc6aN09moJIQGJDmam67Gg=="}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:17:25.423579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-09c32d58-fff6-42a2-8843-007b877379fc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for project d32287a21bed4346ae982132d4f29764. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 21:17:25.427581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-09c32d58-fff6-42a2-8843-007b877379fc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for user ce3a8645c67e438f8f4e6aa933daeb26 and project d32287a21bed4346ae982132d4f29764. Resources: {'key_pairs'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 21:17:25.528115 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-09c32d58-fff6-42a2-8843-007b877379fc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280345 May 12 21:17:25.528719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1188/2395] 10.222.0.59 () {60 vars in 1158 bytes} [Thu May 12 21:17:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:17:44.766745 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1881330059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084107512", "security_groups": [{"name": "tempest-secgroup-smoke-1769528067"}], "block_device_mapping_v2": [{"uuid": "bf7578ce-1469-4f20-9ec6-bd34a3468eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0fd0cd7c-c151-4764-8048-6bd10e54dc02"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:17:44.974684 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] validate_networks() for [('0fd0cd7c-c151-4764-8048-6bd10e54dc02', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 21:17:45.455668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 21:17:45.456095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 21:17:45.456568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 21:17:45.456978 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 21:17:45.457413 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 21:17:45.466097 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:45.466549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:45.467345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:45.467782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:45.484278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 21:17:45.488159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for user ce3a8645c67e438f8f4e6aa933daeb26 and project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 21:17:45.545489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 21:17:45.547665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf7578ce-1469-4f20-9ec6-bd34a3468eb0',volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 21:17:45.873257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-97a464f4-ba5d-4a79-9a07-86873df9f2ba tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.110273 May 12 21:17:45.874227 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1189/2396] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 21:17:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 21:17:45.885094 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b19b0eb0-5f35-4a09-9eae-b8811c332ae1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:45.885744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b19b0eb0-5f35-4a09-9eae-b8811c332ae1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:45.941235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b19b0eb0-5f35-4a09-9eae-b8811c332ae1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:45.949147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b19b0eb0-5f35-4a09-9eae-b8811c332ae1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1095 microversion: 2.1 time: 0.067261 May 12 21:17:45.950154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1190/2397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:45 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:17:46.966772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:46.967358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:46.973826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:46.974272 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:46.975025 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:46.975466 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:47.046096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:47.053411 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-28798d56-a56d-408b-9f6a-b5eb6343a8a3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1145 microversion: 2.1 time: 0.091341 May 12 21:17:47.054013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1191/2398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:46 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:48.069662 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:48.070382 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:48.077346 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:48.077905 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:48.078679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:48.079136 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:48.160445 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:48.167896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-45229101-edc1-4cf2-9871-ba970afadbaf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1201 microversion: 2.1 time: 0.102064 May 12 21:17:48.178074 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1192/2399] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:48 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:49.187830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:49.188489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:49.194703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:49.195154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:49.195920 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:49.196361 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:49.399713 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:49.408799 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-79048c2a-6eba-4fe9-8728-253c45ac42ea tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1279 microversion: 2.1 time: 0.225499 May 12 21:17:49.409397 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1193/2400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:49 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:49.868075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-5c56e2f5-e8a1-43b5-958c-528d625e6be2 req-92bfcc63-c662-4fe4-b386-c4301d0e4d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f876a5-9a3a-4510-8c55-207ceab92f2b", "tag": "f49a1dbf-fd00-4496-b85e-8903e81f47fd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:17:49.878044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c56e2f5-e8a1-43b5-958c-528d625e6be2 req-92bfcc63-c662-4fe4-b386-c4301d0e4d6a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:49.878629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-5c56e2f5-e8a1-43b5-958c-528d625e6be2 req-92bfcc63-c662-4fe4-b386-c4301d0e4d6a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:49.893431 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-5c56e2f5-e8a1-43b5-958c-528d625e6be2 req-92bfcc63-c662-4fe4-b386-c4301d0e4d6a service nova] Creating event network-changed:f49a1dbf-fd00-4496-b85e-8903e81f47fd for instance d7f876a5-9a3a-4510-8c55-207ceab92f2b on hv-cinder-81565 May 12 21:17:49.899360 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-5c56e2f5-e8a1-43b5-958c-528d625e6be2 req-92bfcc63-c662-4fe4-b386-c4301d0e4d6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106945 May 12 21:17:49.900123 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1194/2401] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:17:50.426545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:50.427252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:50.433421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:50.433876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:50.434642 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:50.435628 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:50.571415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:50.579143 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-21ed8eda-7b7b-4692-9054-371e58c8de4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.157292 May 12 21:17:50.579708 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1195/2402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:50 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:51.596993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:51.597689 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:51.603934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:51.604392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:51.605149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:51.605617 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:51.735185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:51.742422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6dd8f218-c8e0-4310-b6a6-79d32f0d5c6f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.149303 May 12 21:17:51.742976 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1196/2403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:51 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:52.759727 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:52.760326 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:52.767235 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:52.767681 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:52.768440 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:52.768880 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:52.899649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:52.907051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-d88c4ad4-a188-43d3-aec7-054106d748ca tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.151274 May 12 21:17:52.907620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1197/2404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:52 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:53.923986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:53.924589 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:53.931935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:53.932381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:53.933141 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:53.933613 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:54.087593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:54.094986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-15f6784f-225e-4522-9aa0-e987b20f95b0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.174886 May 12 21:17:54.095550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1198/2405] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:53 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:55.111810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:55.112430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:55.118801 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:55.119185 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:55.120306 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:55.120389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:55.251716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:55.259580 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-742eaca4-b4f9-40e3-8892-3b05f09c09c8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.152670 May 12 21:17:55.260162 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1199/2406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:55 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:56.277779 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:56.278401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:56.284805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:56.285255 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:56.286053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:56.286489 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:56.418834 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:56.426376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4f93ceb2-b9e5-4791-8b0a-ce895e0eeb20 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.152578 May 12 21:17:56.426884 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1200/2407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:56 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:57.443513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:57.444120 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:57.450479 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:57.451061 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:57.451827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:57.452263 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:57.582618 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:57.590246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4ab16b72-ef96-4f96-ad5b-6cd94328a4b8 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.150546 May 12 21:17:57.590823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1201/2408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:57 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:58.609245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:58.609883 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:58.616199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:58.616653 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:58.617454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:58.617901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:58.748423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:58.755707 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-866abad8-2d7d-45e5-8888-bbf0133b35f3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.151078 May 12 21:17:58.756209 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1202/2409] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:58 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:59.772936 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:17:59.774313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:17:59.780237 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:59.780694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:59.781500 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:59.781946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:17:59.914037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:17:59.922714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-92d006dc-9872-41c8-a4ee-1c00909674a4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.153673 May 12 21:17:59.923290 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1203/2410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:17:59 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:17:59.980892 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-ca07e589-fb3c-4a22-a27f-75cb6db1016d req-f9e0c14f-817c-480c-bdad-41f9b161266d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f876a5-9a3a-4510-8c55-207ceab92f2b", "name": "network-vif-plugged", "status": "completed", "tag": "f49a1dbf-fd00-4496-b85e-8903e81f47fd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:17:59.989831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ca07e589-fb3c-4a22-a27f-75cb6db1016d req-f9e0c14f-817c-480c-bdad-41f9b161266d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:17:59.990278 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ca07e589-fb3c-4a22-a27f-75cb6db1016d req-f9e0c14f-817c-480c-bdad-41f9b161266d service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:00.001005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-ca07e589-fb3c-4a22-a27f-75cb6db1016d req-f9e0c14f-817c-480c-bdad-41f9b161266d service nova] Creating event network-vif-plugged:f49a1dbf-fd00-4496-b85e-8903e81f47fd for instance d7f876a5-9a3a-4510-8c55-207ceab92f2b on hv-cinder-81565 May 12 21:18:00.006163 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-ca07e589-fb3c-4a22-a27f-75cb6db1016d req-f9e0c14f-817c-480c-bdad-41f9b161266d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081574 May 12 21:18:00.006758 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1204/2411] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:18:00.941242 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:18:00.942003 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:18:00.948365 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:00.948817 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:00.949612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:00.950052 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:01.084781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:18:01.092668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99773bd4-6e6a-48eb-a40a-1acb95909403 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1267 microversion: 2.1 time: 0.156284 May 12 21:18:01.093229 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1205/2412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:18:00 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:18:02.110057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:18:02.110901 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:18:02.117553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:02.117946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:02.118716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:02.119159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:02.251699 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:18:02.260565 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0fe11515-5d0b-4cd5-85a0-ec232afba38f tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1454 microversion: 2.1 time: 0.155423 May 12 21:18:02.261160 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1206/2413] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:18:02 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:18:02.276994 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:18:02.277623 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:18:02.284693 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:02.285145 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:02.286041 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:02.286484 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:02.687619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:18:02.695199 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1faeb9f5-1375-4a16-85f8-13758af9e705 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1454 microversion: 2.1 time: 0.422138 May 12 21:18:02.695768 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1207/2414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:18:02 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1454 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:18:04.732408 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-4fe9dd1e-489d-40e3-8331-d0feb87227ca req-58c426a8-43e7-42f0-8284-7da50cf2a73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f876a5-9a3a-4510-8c55-207ceab92f2b", "tag": "f49a1dbf-fd00-4496-b85e-8903e81f47fd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:18:04.741833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-4fe9dd1e-489d-40e3-8331-d0feb87227ca req-58c426a8-43e7-42f0-8284-7da50cf2a73e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:18:04.742281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-4fe9dd1e-489d-40e3-8331-d0feb87227ca req-58c426a8-43e7-42f0-8284-7da50cf2a73e service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:18:04.754024 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-4fe9dd1e-489d-40e3-8331-d0feb87227ca req-58c426a8-43e7-42f0-8284-7da50cf2a73e service nova] Creating event network-changed:f49a1dbf-fd00-4496-b85e-8903e81f47fd for instance d7f876a5-9a3a-4510-8c55-207ceab92f2b on hv-cinder-81565 May 12 21:18:04.758929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-4fe9dd1e-489d-40e3-8331-d0feb87227ca req-58c426a8-43e7-42f0-8284-7da50cf2a73e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030177 May 12 21:18:04.759519 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1208/2415] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:18:07.444424 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:18:07.444952 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:19:52.423253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:19:52.423791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:19:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:19:59.128407 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ca5c3629-bce7-49cd-a7a9-4ac4c7a59d9e] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 21:19:59.132599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:19:59.133176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:19:59.139386 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:19:59.139827 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:19:59.140574 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:19:59.141001 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:19:59.166670 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 21:19:59.468134 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e501175f-35e9-4cf1-ba49-88a2830f1ab5 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 204 len: 0 microversion: 2.1 time: 0.341135 May 12 21:19:59.468639 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1209/2416] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:19:59 2022] DELETE /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 21:19:59.477635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:19:59.478338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:19:59.484338 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:19:59.484809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:19:59.485603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:19:59.486044 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:19:59.635216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:19:59.642635 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8c8aa7c0-dc36-4295-aefa-644d6c5ee8c0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1579 microversion: 2.1 time: 0.169833 May 12 21:19:59.643201 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1210/2417] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:19:59 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:00.660029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:00.660679 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:00.669154 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:00.669631 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:00.670401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:00.670837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:00.676092 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] [ca5c3629-bce7-49cd-a7a9-4ac4c7a59d9e] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 42900. May 12 21:20:00.811048 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:00.818849 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a94e8fb9-07a9-413a-b1c7-cd456ea00521 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1579 microversion: 2.1 time: 0.162724 May 12 21:20:00.819997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1211/2418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:00 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:01.838286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:01.838953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:01.845816 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:01.846274 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:01.847037 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:01.847478 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:02.145990 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:02.156700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-062b1c1c-85a9-4df5-a544-eed0274658e0 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1511 microversion: 2.1 time: 0.323153 May 12 21:20:02.157829 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1212/2419] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:01 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:02.337953 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-55b8c3ef-df84-44ad-b093-f6f4ff8f77d6 req-927376d3-b8b9-4bd3-a8f4-a5807b5250e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f876a5-9a3a-4510-8c55-207ceab92f2b", "name": "network-vif-deleted", "tag": "f49a1dbf-fd00-4496-b85e-8903e81f47fd"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:20:02.345658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-55b8c3ef-df84-44ad-b093-f6f4ff8f77d6 req-927376d3-b8b9-4bd3-a8f4-a5807b5250e7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:02.346108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-55b8c3ef-df84-44ad-b093-f6f4ff8f77d6 req-927376d3-b8b9-4bd3-a8f4-a5807b5250e7 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:02.357939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-55b8c3ef-df84-44ad-b093-f6f4ff8f77d6 req-927376d3-b8b9-4bd3-a8f4-a5807b5250e7 service nova] Creating event network-vif-deleted:f49a1dbf-fd00-4496-b85e-8903e81f47fd for instance d7f876a5-9a3a-4510-8c55-207ceab92f2b on hv-cinder-81565 May 12 21:20:02.362929 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-55b8c3ef-df84-44ad-b093-f6f4ff8f77d6 req-927376d3-b8b9-4bd3-a8f4-a5807b5250e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029236 May 12 21:20:02.363515 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1213/2420] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:20:03.175341 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:03.176149 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:03.184369 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:03.184821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:03.185663 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:03.186098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:03.221696 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:03.222147 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:03.222590 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lazy-loading 'fault' on Instance uuid d7f876a5-9a3a-4510-8c55-207ceab92f2b {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 21:20:03.269804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:03.278159 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f8ad6f6c-e4a0-449c-8486-e7e258d09bfa tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 200 len: 1231 microversion: 2.1 time: 0.107604 May 12 21:20:03.278716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1214/2421] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:03 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:04.294282 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:04.294935 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:04.301437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:04.301895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:04.302659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:04.303103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:04.316948 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] HTTP exception thrown: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Request method failure captured: May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b HTTP/1.1 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXlefkyF9inoZOKRAsjAkYt5XXwB6u8QW6niECP3Hg58CuSXufls4D32l03EF-fp9dfbbRjAXVHwdN1NSDFGUVxaLhIa3unO-wLuSX0UrEMsE5F1zmqNnkQicSFh0xCE1ZamDanmW6D13gGLXZ2FDffTqI-tJQHOx5XzKeBOr2bzKQo May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: d32287a21bed4346ae982132d4f29764 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:20:04.318736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d32287a21bed4346ae982132d4f29764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d32287a21bed4346ae982132d4f29764", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestVolumeBootPattern-784875913 May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: d32287a21bed4346ae982132d4f29764 May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestVolumeBootPattern-784875913-project May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: ce3a8645c67e438f8f4e6aa933daeb26 May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestVolumeBootPattern-784875913-project May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:20:04.320939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'd7f876a5-9a3a-4510-8c55-207ceab92f2b'} May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:20:04.321761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:20:04.322949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:20:04.324150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Returning 404 to user: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:20:04.324150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f4ad0363-4d7c-4e40-9daf-eb3d1763ab37 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 404 len: 111 microversion: 2.1 time: 0.030354 May 12 21:20:04.324150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1215/2422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:04 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:20:04.369950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-96940250", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084107512", "security_groups": [{"name": "tempest-secgroup-smoke-1769528067"}], "block_device_mapping_v2": [{"uuid": "bf7578ce-1469-4f20-9ec6-bd34a3468eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0fd0cd7c-c151-4764-8048-6bd10e54dc02"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:20:04.481142 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] validate_networks() for [('0fd0cd7c-c151-4764-8048-6bd10e54dc02', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 21:20:04.862748 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 21:20:04.863173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 21:20:04.863649 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 21:20:04.864164 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 21:20:04.864773 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 21:20:04.874019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:04.874469 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:04.875259 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:04.875725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:04.891627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 21:20:04.895518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for user ce3a8645c67e438f8f4e6aa933daeb26 and project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 21:20:04.953178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 21:20:04.955277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf7578ce-1469-4f20-9ec6-bd34a3468eb0',volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 21:20:05.348554 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-121ce18b-0b00-4f49-9f3a-d4ffcd55bca4 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983361 May 12 21:20:05.349244 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1216/2423] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 21:20:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 21:20:05.359412 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2b233178-c47c-4b44-97f6-2c894f86534c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:05.360168 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2b233178-c47c-4b44-97f6-2c894f86534c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:05.413832 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2b233178-c47c-4b44-97f6-2c894f86534c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:05.420117 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2b233178-c47c-4b44-97f6-2c894f86534c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1093 microversion: 2.1 time: 0.064438 May 12 21:20:05.420676 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1217/2424] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:05 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:06.436805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:06.437534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:06.444747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:06.445430 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:06.446205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:06.446651 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:06.508104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:06.515776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b4e11186-12a5-4df9-9a06-08a13d2cb529 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1143 microversion: 2.1 time: 0.082825 May 12 21:20:06.519791 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1218/2425] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:06 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:07.533879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:07.534627 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:07.542273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:07.542733 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:07.543512 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:07.543968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:07.612793 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:07.621205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f62136c5-30fa-4aa5-bd88-22312d2f9763 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1209 microversion: 2.1 time: 0.091938 May 12 21:20:07.621812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1219/2426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:07 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:08.638868 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:08.639498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:08.645726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:08.646178 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:08.646944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:08.647996 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:08.795771 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:08.803216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1cf3f1ae-e78c-4d75-be19-4577d8b8e022 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.168341 May 12 21:20:08.804736 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1220/2427] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:08 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:09.126152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-fba37e62-419d-4cf2-9ea5-8aacab015e15 req-02c2d55d-f1a5-4fba-a2e6-6d47c7edda41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce1a77d-3764-4225-b0a4-45a1c5603cbf", "tag": "97554eef-a39b-482c-bf5d-d675c1b4e272"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:20:09.136249 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fba37e62-419d-4cf2-9ea5-8aacab015e15 req-02c2d55d-f1a5-4fba-a2e6-6d47c7edda41 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:09.136846 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-fba37e62-419d-4cf2-9ea5-8aacab015e15 req-02c2d55d-f1a5-4fba-a2e6-6d47c7edda41 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:09.149763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-fba37e62-419d-4cf2-9ea5-8aacab015e15 req-02c2d55d-f1a5-4fba-a2e6-6d47c7edda41 service nova] Creating event network-changed:97554eef-a39b-482c-bf5d-d675c1b4e272 for instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf on hv-cinder-81565 May 12 21:20:09.155454 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-fba37e62-419d-4cf2-9ea5-8aacab015e15 req-02c2d55d-f1a5-4fba-a2e6-6d47c7edda41 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033254 May 12 21:20:09.156223 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1221/2428] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:20:09.821654 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:09.822363 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:09.828867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:09.832537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:09.832537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:09.832537 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:09.968625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:09.976077 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3b334ad9-b2ea-4dae-90e5-1c092a51aca3 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.159705 May 12 21:20:09.976761 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1222/2429] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:09 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:10.776432 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:20:10.776955 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:20:10.992894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:10.993529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:11.000655 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:11.001105 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:11.001916 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:11.002351 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:11.133485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:11.140700 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-5d459b28-f8ee-41e6-a40d-5b8904e09b39 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.151771 May 12 21:20:11.141264 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1223/2430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:10 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:12.157940 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:12.158551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:12.165784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:12.166236 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:12.166997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:12.167432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:12.298869 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:12.306632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e4607377-d833-41d1-9b2b-66e072f0da49 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.152546 May 12 21:20:12.307188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1224/2431] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:12 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:13.323153 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:13.323797 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:13.330113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:13.330558 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:13.331313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:13.331747 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:13.461245 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:13.468493 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9cf61f2a-3d21-4f1b-b224-26246e6506e1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.149954 May 12 21:20:13.469049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1225/2432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:13 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:20:14.486362 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:14.486977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:14.493688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:14.494129 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:14.494878 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:14.495309 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:14.627165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:14.635174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f3bb55f5-72b5-4c2f-ba04-54cd75264214 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.152774 May 12 21:20:14.635742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1226/2433] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:14 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:15.652812 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:15.653490 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:15.659795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:15.660240 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:15.660995 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:15.661464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:15.791319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:15.798772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4c3784b0-d7b3-45a2-996b-6a8a67c70b63 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.150051 May 12 21:20:15.799345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1227/2434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:15 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:16.815967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:16.816612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:16.822897 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:16.823345 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:16.824113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:16.824545 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:16.956482 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:16.964481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-cedb9d3b-9ecd-4f4d-833d-912bed43345c tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.152415 May 12 21:20:16.965059 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1228/2435] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:16 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:17.982152 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:17.982788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:17.989046 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:17.989517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:17.990273 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:17.991836 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:18.125148 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:18.132865 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-1925455c-e916-4041-b0ec-2910caf4e574 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.154505 May 12 21:20:18.133452 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1229/2436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:17 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:18.494073 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-ac19c99b-338b-402c-b10a-9417ba19fd4e req-41a9913b-f4ea-4550-8a9b-55c2e5e9d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce1a77d-3764-4225-b0a4-45a1c5603cbf", "name": "network-vif-plugged", "status": "completed", "tag": "97554eef-a39b-482c-bf5d-d675c1b4e272"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:20:18.502004 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ac19c99b-338b-402c-b10a-9417ba19fd4e req-41a9913b-f4ea-4550-8a9b-55c2e5e9d2f0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:18.502513 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ac19c99b-338b-402c-b10a-9417ba19fd4e req-41a9913b-f4ea-4550-8a9b-55c2e5e9d2f0 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:18.513599 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-ac19c99b-338b-402c-b10a-9417ba19fd4e req-41a9913b-f4ea-4550-8a9b-55c2e5e9d2f0 service nova] Creating event network-vif-plugged:97554eef-a39b-482c-bf5d-d675c1b4e272 for instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf on hv-cinder-81565 May 12 21:20:18.518688 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-ac19c99b-338b-402c-b10a-9417ba19fd4e req-41a9913b-f4ea-4550-8a9b-55c2e5e9d2f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029263 May 12 21:20:18.519271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1230/2437] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:20:19.150902 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:19.151781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:19.157950 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:19.158409 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:19.159202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:19.159647 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:19.296520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:19.304252 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0c240844-55b8-4688-98d0-6e1cc5a7fcdc tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1265 microversion: 2.1 time: 0.158656 May 12 21:20:19.304809 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1231/2438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:19 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:20.320782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:20.321422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:20.327742 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:20.328198 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:20.328957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:20.329438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:20.460579 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:20.468010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fdeace84-70ed-4709-a997-7a244eafc473 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1452 microversion: 2.1 time: 0.151301 May 12 21:20:20.468571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1232/2439] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:20 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:20.484322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:20:20.484926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:20:20.490776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:20.491316 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:20.492070 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:20.492504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:20.623970 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:20:20.631864 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-27636461-656b-4a44-bf1f-cfbfd25da741 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1452 microversion: 2.1 time: 0.150541 May 12 21:20:20.632421 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1233/2440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:20:20 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:20:22.615893 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-301813d5-c76c-4375-89eb-bb19be4d64fc req-30a8d793-b3e1-4b0f-aecb-09535fab9111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce1a77d-3764-4225-b0a4-45a1c5603cbf", "tag": "97554eef-a39b-482c-bf5d-d675c1b4e272"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:20:22.624389 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-301813d5-c76c-4375-89eb-bb19be4d64fc req-30a8d793-b3e1-4b0f-aecb-09535fab9111 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:20:22.624826 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-301813d5-c76c-4375-89eb-bb19be4d64fc req-30a8d793-b3e1-4b0f-aecb-09535fab9111 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:20:22.636437 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-301813d5-c76c-4375-89eb-bb19be4d64fc req-30a8d793-b3e1-4b0f-aecb-09535fab9111 service nova] Creating event network-changed:97554eef-a39b-482c-bf5d-d675c1b4e272 for instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf on hv-cinder-81565 May 12 21:20:22.641706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-301813d5-c76c-4375-89eb-bb19be4d64fc req-30a8d793-b3e1-4b0f-aecb-09535fab9111 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029471 May 12 21:20:22.642300 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1234/2441] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:21:27.452689 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:21:27.453263 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:21:32.160137 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:32.160725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:32.166874 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:32.167322 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:32.168668 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:32.169103 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:32.195553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 21:21:32.478375 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-71c4f80c-08e1-4be2-906a-af9460d66685 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 204 len: 0 microversion: 2.1 time: 0.323427 May 12 21:21:32.478888 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1235/2442] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:21:32 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 21:21:32.487881 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:32.488606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:32.494568 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:32.495013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:32.495798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:32.496804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:32.625327 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:21:32.633414 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-efc9c8a1-2584-44c0-9d4b-e5bf6d6cabc6 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1718 microversion: 2.1 time: 0.149491 May 12 21:21:32.633984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1236/2443] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:32 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:21:33.651949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:33.653728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:33.660173 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:33.660625 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:33.661463 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:33.661899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:33.898562 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:21:33.906787 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b1968282-4c60-4f78-af31-5a37c8c2bc9d tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1718 microversion: 2.1 time: 0.258785 May 12 21:21:33.907398 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1237/2444] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:33 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1718 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:21:34.133934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-408b1085-e78f-4fab-ba4a-e125091bdf12 req-94acc78a-fb96-4c38-bebc-8031aeb155f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5583a9e-213d-4250-afa6-8a77981ef335", "name": "network-vif-deleted", "tag": "a86b8e9b-9010-40d0-a396-b8285e4fabfe"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:21:34.144238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-408b1085-e78f-4fab-ba4a-e125091bdf12 req-94acc78a-fb96-4c38-bebc-8031aeb155f4 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:34.144782 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-408b1085-e78f-4fab-ba4a-e125091bdf12 req-94acc78a-fb96-4c38-bebc-8031aeb155f4 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:34.157238 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-408b1085-e78f-4fab-ba4a-e125091bdf12 req-94acc78a-fb96-4c38-bebc-8031aeb155f4 service nova] Creating event network-vif-deleted:a86b8e9b-9010-40d0-a396-b8285e4fabfe for instance c5583a9e-213d-4250-afa6-8a77981ef335 on hv-cinder-81565 May 12 21:21:34.165575 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-408b1085-e78f-4fab-ba4a-e125091bdf12 req-94acc78a-fb96-4c38-bebc-8031aeb155f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035364 May 12 21:21:34.166470 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1238/2445] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:21:34.925938 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:34.926504 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:34.935424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:34.936194 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:34.937295 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:34.937939 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:34.972098 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:34.972547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:34.973029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lazy-loading 'fault' on Instance uuid c5583a9e-213d-4250-afa6-8a77981ef335 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 21:21:35.023906 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fa08cd466c419e80198a5b44b719f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726b268af80347bbbf58e80cef5c61bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:21:35.035540 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e23ad2f8-4552-4794-9d2e-e224532978e1 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 200 len: 1461 microversion: 2.1 time: 0.114140 May 12 21:21:35.036620 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1239/2446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:34 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:21:36.053886 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:36.054581 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:36.061528 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:36.061977 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:36.062735 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:36.063169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:36.076603 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 HTTP/1.1 May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:21:36.078270 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:36.082268 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'c5583a9e-213d-4250-afa6-8a77981ef335'} May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:21:36.083113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:36.084155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:36.085085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:21:36.085085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-b60ad993-103a-46b5-b9cd-ddbcb61289b4 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 404 len: 111 microversion: 2.1 time: 0.029634 May 12 21:21:36.085085 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1240/2447] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:36 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:21:36.088171 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-bbfdc123-402e-40e2-b5e3-68e050153ecb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '.version_select at 0x7f4e680b6700>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:36.158930 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-bbfdc123-402e-40e2-b5e3-68e050153ecb tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006571929" status: 202 len: 0 microversion: 2.1 time: 0.074243 May 12 21:21:36.159424 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1241/2448] 10.222.0.59 () {58 vars in 1220 bytes} [Thu May 12 21:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006571929 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 21:21:39.680546 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:39.681174 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:39.689952 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:39.690422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:39.691169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:39.691600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:39.705551 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 HTTP/1.1 May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:21:39.714629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.717050 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'c5583a9e-213d-4250-afa6-8a77981ef335'} May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:21:39.717726 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.718732 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.719743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:21:39.719743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a556c243-6fb9-4989-b63b-7067ce19dff7 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 404 len: 111 microversion: 2.1 time: 0.032361 May 12 21:21:39.719743 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1242/2449] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:21:39 2022] DELETE /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:21:39.722686 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:39.723364 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: c5583a9e-213d-4250-afa6-8a77981ef335] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:39.729254 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:39.729738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:39.730503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:39.731054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:39.747498 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 HTTP/1.1 May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:21:39.749012 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.750368 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'c5583a9e-213d-4250-afa6-8a77981ef335'} May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:21:39.750968 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. May 12 21:21:39.751914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:39.752802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance c5583a9e-213d-4250-afa6-8a77981ef335 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:21:39.752802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f38fdb5b-f25e-499d-8f43-917f2ef3322a tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335" status: 404 len: 111 microversion: 2.1 time: 0.031715 May 12 21:21:39.752802 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1243/2450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:39 2022] GET /compute/v2.1/servers/c5583a9e-213d-4250-afa6-8a77981ef335 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:21:41.046772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:41.047319 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:41.053860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:41.054313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:41.055075 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:41.055521 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:41.068805 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d HTTP/1.1 May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:21:41.070373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.071728 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0fbc0365-6647-411e-9225-26ead37c724d'} May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:21:41.072476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.073725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.075633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:21:41.075633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-4e9a6924-d445-40ed-9520-60ecc3b69267 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 404 len: 111 microversion: 2.1 time: 0.028996 May 12 21:21:41.075633 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1244/2451] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:21:41 2022] DELETE /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:21:41.080441 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:21:41.081054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] [instance: 0fbc0365-6647-411e-9225-26ead37c724d] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:21:41.086823 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:41.087277 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:41.088033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:21:41.088477 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:21:41.102210 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] HTTP exception thrown: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Request method failure captured: May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d HTTP/1.1 May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXB6bimbjOasUdXXvLsShcdGxZ9s7vBSdzvxaQwG-_ZhFqeoJqb9_oaAvJZpcE9Pn6MwxpYL58zGSjmw8vNfFSytWh8vACMVuKVHE9hhigefyrOVxKYDLNRS5s9VqYGhNDoWO5h0AkFDlB6uDGY07vo8Z4YCuYXPLybnutFHDu8C5dw May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:21:41.103738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_726b268af80347bbbf58e80cef5c61bc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/726b268af80347bbbf58e80cef5c61bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: 726b268af80347bbbf58e80cef5c61bc May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-580969122 May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: e3fa08cd466c419e80198a5b44b719f9 May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-AttachVolumeTestJSON-580969122-project May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.105031 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '0fbc0365-6647-411e-9225-26ead37c724d'} May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:21:41.105833 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. May 12 21:21:41.107824 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:21:41.109914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] Returning 404 to user: Instance 0fbc0365-6647-411e-9225-26ead37c724d could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:21:41.109914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7785b54f-a2bb-41ec-b086-95d44e5829e0 tempest-AttachVolumeTestJSON-580969122 tempest-AttachVolumeTestJSON-580969122-project] 10.222.0.59 "GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d" status: 404 len: 111 microversion: 2.1 time: 0.028174 May 12 21:21:41.109914 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1245/2452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:21:41 2022] GET /compute/v2.1/servers/0fbc0365-6647-411e-9225-26ead37c724d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 21:22:15.329804 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2092558504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2084107512", "security_groups": [{"name": "tempest-secgroup-smoke-1769528067"}], "block_device_mapping_v2": [{"uuid": "9d365a00-958b-4e33-bc79-c75dc1d85c56", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0fd0cd7c-c151-4764-8048-6bd10e54dc02"}]}} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:22:15.444448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.network.neutron [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] validate_networks() for [('0fd0cd7c-c151-4764-8048-6bd10e54dc02', None, None, None, None, None)] {{(pid=129357) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 21:22:15.806682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 21:22:15.807101 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image limits 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 21:22:15.807571 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Flavor pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 21:22:15.808007 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Image pref 0:0:0 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 21:22:15.808416 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.virt.hardware [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 21:22:15.817084 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:15.818658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:15.819471 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:15.819907 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:15.836280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 21:22:15.840121 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.quota [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Getting quotas for user ce3a8645c67e438f8f4e6aa933daeb26 and project d32287a21bed4346ae982132d4f29764. Resources: {'instances', 'ram', 'cores'} {{(pid=129357) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 21:22:15.898444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Going to run 1 instances... {{(pid=129357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 21:22:15.900555 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d365a00-958b-4e33-bc79-c75dc1d85c56',volume_size=None,volume_type=None)] {{(pid=129357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 21:22:16.382966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-90c5c801-7b28-49be-8917-76f0f9f6d909 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.059618 May 12 21:22:16.383694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1246/2453] 10.222.0.59 () {60 vars in 1146 bytes} [Thu May 12 21:22:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 21:22:16.393305 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2777d52a-df19-4a35-86ed-aba475d13244 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:16.393873 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2777d52a-df19-4a35-86ed-aba475d13244 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:16.452313 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2777d52a-df19-4a35-86ed-aba475d13244 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:16.460637 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2777d52a-df19-4a35-86ed-aba475d13244 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1095 microversion: 2.1 time: 0.071070 May 12 21:22:16.461464 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1247/2454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:16 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:17.478399 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:17.479040 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:17.485406 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:17.485860 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:17.486629 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:17.487069 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:17.548186 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:17.556216 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-0b25c810-f728-4a5f-a2bc-b40b6226e29a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1145 microversion: 2.1 time: 0.082326 May 12 21:22:17.556776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1248/2455] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:17 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:18.574561 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:18.575176 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:18.581544 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:18.583332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:18.583332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:18.583332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:18.646457 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:18.654645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-dfa26ec8-dd41-45e5-b6dd-5fe4be4b4644 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1193 microversion: 2.1 time: 0.084160 May 12 21:22:18.655205 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1249/2456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:18 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:19.671720 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:19.672376 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:19.679933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:19.680383 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:19.681165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:19.681645 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:19.772287 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:19.780377 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7b2395f1-9fe1-4137-b5b1-6461fd2bd0e6 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1211 microversion: 2.1 time: 0.112578 May 12 21:22:19.780951 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1250/2457] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:19 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:20.797039 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:20.798051 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:20.804894 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:20.805379 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:20.806246 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:20.806685 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:21.014922 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:21.026885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fc1d65a8-a7b6-473f-a654-091021d238bf tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.233644 May 12 21:22:21.027476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1251/2458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:20 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:21.037208 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-e22b23ce-ee4e-499c-bff7-f2e53d2f1e12 req-1dcfffe9-00e3-4813-b8ea-e3eaa52ffdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2c633e-b42f-4908-9fff-7cc274b0d6f3", "tag": "cd42d916-028d-4a8f-8d84-7de0fefaa08a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:22:21.046415 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-e22b23ce-ee4e-499c-bff7-f2e53d2f1e12 req-1dcfffe9-00e3-4813-b8ea-e3eaa52ffdc6 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:21.047496 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-e22b23ce-ee4e-499c-bff7-f2e53d2f1e12 req-1dcfffe9-00e3-4813-b8ea-e3eaa52ffdc6 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:21.062667 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-e22b23ce-ee4e-499c-bff7-f2e53d2f1e12 req-1dcfffe9-00e3-4813-b8ea-e3eaa52ffdc6 service nova] Creating event network-changed:cd42d916-028d-4a8f-8d84-7de0fefaa08a for instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 on hv-cinder-81565 May 12 21:22:21.069047 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-e22b23ce-ee4e-499c-bff7-f2e53d2f1e12 req-1dcfffe9-00e3-4813-b8ea-e3eaa52ffdc6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 May 12 21:22:21.070000 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1252/2459] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:22:22.045286 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:22.046054 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:22.051921 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:22.052367 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:22.054403 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:22.054844 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:22.258960 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:22.266843 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e2ce12b0-da40-47f9-8060-a182feeb98be tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.226131 May 12 21:22:22.267475 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1253/2460] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:22 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:23.284547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:23.285266 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:23.292366 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:23.292821 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:23.293641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:23.294081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:23.431438 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:23.438657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a5a9b940-1f96-4ce0-ae4f-570ce3527128 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.158118 May 12 21:22:23.439218 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1254/2461] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:23 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:24.455169 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:24.455795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:24.462896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:24.463381 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:24.464166 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:24.464605 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:24.611243 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:24.619709 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-6a080814-a739-4657-a778-fd3e1254ff12 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.168655 May 12 21:22:24.620279 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1255/2462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:24 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:25.873298 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:25.873967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:25.880102 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:25.880458 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:25.881283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:25.881703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:26.297993 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:26.306207 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-100b8a24-a614-477e-a0cf-a889708f792b tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.673970 May 12 21:22:26.306795 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1256/2463] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:25 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:27.323213 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:27.323867 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:27.330070 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:27.330518 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:27.331281 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:27.331712 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:27.470563 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:27.479250 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-2f754eca-22c5-4af1-b397-70a14f14ddce tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.160226 May 12 21:22:27.479989 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1257/2464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:27 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:28.497664 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:28.498448 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:28.505005 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:28.505766 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:28.506955 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:28.507396 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:28.651042 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:28.658987 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-91d54918-084a-4b3f-84d1-34a5d08184e9 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.165312 May 12 21:22:28.659549 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1258/2465] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:28 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:29.678057 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:29.678714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:29.686764 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:29.687716 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:29.688714 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:29.689401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:29.830763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:29.838756 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-99f35c1b-b964-4f26-b80d-fafafedadc38 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.165334 May 12 21:22:29.839332 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1259/2466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:29 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:30.854984 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:30.855606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:30.861738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:30.862202 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:30.862981 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:30.863423 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:30.999798 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:31.007280 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-30470d1e-cbc1-4bf8-a431-ec280721469e tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.156350 May 12 21:22:31.008592 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1260/2467] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:30 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:31.194998 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-9ad4301a-d3aa-477c-aa85-e860b609460e req-16ed39dc-f268-45c1-8d65-6995ee92a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2c633e-b42f-4908-9fff-7cc274b0d6f3", "name": "network-vif-plugged", "status": "completed", "tag": "cd42d916-028d-4a8f-8d84-7de0fefaa08a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:22:31.203933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9ad4301a-d3aa-477c-aa85-e860b609460e req-16ed39dc-f268-45c1-8d65-6995ee92a946 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:31.204378 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-9ad4301a-d3aa-477c-aa85-e860b609460e req-16ed39dc-f268-45c1-8d65-6995ee92a946 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:31.216762 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-9ad4301a-d3aa-477c-aa85-e860b609460e req-16ed39dc-f268-45c1-8d65-6995ee92a946 service nova] Creating event network-vif-plugged:cd42d916-028d-4a8f-8d84-7de0fefaa08a for instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 on hv-cinder-81565 May 12 21:22:31.222016 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-9ad4301a-d3aa-477c-aa85-e860b609460e req-16ed39dc-f268-45c1-8d65-6995ee92a946 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031156 May 12 21:22:31.222606 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1261/2468] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:22:32.027770 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:32.028719 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:32.034876 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:32.035320 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:32.036108 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:32.036550 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:32.172076 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:32.179796 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-9a0c52ea-9a5a-47d2-9e8b-3baa83e028a1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1267 microversion: 2.1 time: 0.157616 May 12 21:22:32.180559 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1262/2469] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:32 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:33.196155 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:33.197468 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:33.203992 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:33.204461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:33.205226 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:33.205780 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:33.335830 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:33.343957 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a198f554-7ecb-463d-a87d-0b74793c2b48 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1454 microversion: 2.1 time: 0.151900 May 12 21:22:33.344517 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1263/2470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:33 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:33.361029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:22:33.361632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:22:33.367444 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:33.367896 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:33.368848 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:33.369507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:33.515109 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:22:33.522632 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-96149462-debc-4f63-a13c-558b24907a92 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1454 microversion: 2.1 time: 0.165585 May 12 21:22:33.523188 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1264/2471] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:22:33 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:22:35.773065 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-8a3c95cc-fc6f-4c5d-8c1a-9f4efe08aae8 req-c62b17f0-f08f-42ad-83e9-2d8df1ae5425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2c633e-b42f-4908-9fff-7cc274b0d6f3", "tag": "cd42d916-028d-4a8f-8d84-7de0fefaa08a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:22:35.782476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-8a3c95cc-fc6f-4c5d-8c1a-9f4efe08aae8 req-c62b17f0-f08f-42ad-83e9-2d8df1ae5425 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:22:35.782915 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-8a3c95cc-fc6f-4c5d-8c1a-9f4efe08aae8 req-c62b17f0-f08f-42ad-83e9-2d8df1ae5425 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:22:35.795049 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-8a3c95cc-fc6f-4c5d-8c1a-9f4efe08aae8 req-c62b17f0-f08f-42ad-83e9-2d8df1ae5425 service nova] Creating event network-changed:cd42d916-028d-4a8f-8d84-7de0fefaa08a for instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 on hv-cinder-81565 May 12 21:22:35.802792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-8a3c95cc-fc6f-4c5d-8c1a-9f4efe08aae8 req-c62b17f0-f08f-42ad-83e9-2d8df1ae5425 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031678 May 12 21:22:35.802792 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1265/2472] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:23:30.785643 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:23:30.786250 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:23:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:24:05.747942 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:05.748772 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:05.755358 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:05.755808 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:05.756578 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:05.757010 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:05.786456 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 21:24:06.104018 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-74fcee98-4741-491c-abea-3691f58dc429 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 204 len: 0 microversion: 2.1 time: 0.361872 May 12 21:24:06.104609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1266/2473] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:24:05 2022] DELETE /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 21:24:06.289465 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-f2c66f64-30c3-470e-810f-a43c962a8d3c req-55960c97-8247-4dc6-a56f-785e00481046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2c633e-b42f-4908-9fff-7cc274b0d6f3", "tag": "cd42d916-028d-4a8f-8d84-7de0fefaa08a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:24:06.297986 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f2c66f64-30c3-470e-810f-a43c962a8d3c req-55960c97-8247-4dc6-a56f-785e00481046 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:06.298432 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-f2c66f64-30c3-470e-810f-a43c962a8d3c req-55960c97-8247-4dc6-a56f-785e00481046 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:06.309975 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-f2c66f64-30c3-470e-810f-a43c962a8d3c req-55960c97-8247-4dc6-a56f-785e00481046 service nova] Creating event network-changed:cd42d916-028d-4a8f-8d84-7de0fefaa08a for instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 on hv-cinder-81565 May 12 21:24:06.314972 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-f2c66f64-30c3-470e-810f-a43c962a8d3c req-55960c97-8247-4dc6-a56f-785e00481046 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208673 May 12 21:24:06.315553 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1267/2474] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:24:06.320666 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:06.321387 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:06.327946 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:06.328422 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:06.329181 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:06.329641 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:06.569619 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:06.577180 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-3cc54863-12bc-4c01-8273-5e4cec3e2985 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1579 microversion: 2.1 time: 0.260463 May 12 21:24:06.577781 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1268/2475] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:06 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:24:07.595156 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:07.595841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:07.602150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:07.602600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:07.603372 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:07.603810 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:07.829019 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:07.836933 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-8652bb50-545d-4fde-a2a4-f6bd359f1005 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1579 microversion: 2.1 time: 0.245802 May 12 21:24:07.837744 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1269/2476] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:07 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1579 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:24:08.253304 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-3a13fa05-d450-4474-b667-a34b58d87ea9 req-be18482d-8ef7-4f76-82fb-46c769d0d49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2c633e-b42f-4908-9fff-7cc274b0d6f3", "name": "network-vif-deleted", "tag": "cd42d916-028d-4a8f-8d84-7de0fefaa08a"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:24:08.262434 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-3a13fa05-d450-4474-b667-a34b58d87ea9 req-be18482d-8ef7-4f76-82fb-46c769d0d49c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:08.262630 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-3a13fa05-d450-4474-b667-a34b58d87ea9 req-be18482d-8ef7-4f76-82fb-46c769d0d49c service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:08.273598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-3a13fa05-d450-4474-b667-a34b58d87ea9 req-be18482d-8ef7-4f76-82fb-46c769d0d49c service nova] Creating event network-vif-deleted:cd42d916-028d-4a8f-8d84-7de0fefaa08a for instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 on hv-cinder-81565 May 12 21:24:08.278997 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-3a13fa05-d450-4474-b667-a34b58d87ea9 req-be18482d-8ef7-4f76-82fb-46c769d0d49c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088166 May 12 21:24:08.280234 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1270/2477] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:24:08.856665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:08.857442 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:08.864192 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:08.864340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:08.865104 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:08.865566 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:08.895841 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:08.896283 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:08.896730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.objects.instance [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lazy-loading 'fault' on Instance uuid 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 {{(pid=129357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 21:24:08.942763 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:08.948151 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-922ca6c4-2290-4184-90e0-298e2749d015 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 200 len: 1231 microversion: 2.1 time: 0.096649 May 12 21:24:08.948862 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1271/2478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:08 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:24:09.966301 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:09.966949 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 4d2c633e-b42f-4908-9fff-7cc274b0d6f3] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:09.973392 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:09.973839 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:09.974593 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:09.975027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:09.988671 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] HTTP exception thrown: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Request method failure captured: May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 HTTP/1.1 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXlefkyF9inoZOKRAsjAkYt5XXwB6u8QW6niECP3Hg58CuSXufls4D32l03EF-fp9dfbbRjAXVHwdN1NSDFGUVxaLhIa3unO-wLuSX0UrEMsE5F1zmqNnkQicSFh0xCE1ZamDanmW6D13gGLXZ2FDffTqI-tJQHOx5XzKeBOr2bzKQo May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:24:09.990333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d32287a21bed4346ae982132d4f29764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d32287a21bed4346ae982132d4f29764", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestVolumeBootPattern-784875913 May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: ce3a8645c67e438f8f4e6aa933daeb26 May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. May 12 21:24:09.992333 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '4d2c633e-b42f-4908-9fff-7cc274b0d6f3'} May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:24:09.993753 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. May 12 21:24:09.995909 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:09.997784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Returning 404 to user: Instance 4d2c633e-b42f-4908-9fff-7cc274b0d6f3 could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:24:09.997784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7cbafc04-7124-4660-ac60-1fb13719c66a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3" status: 404 len: 111 microversion: 2.1 time: 0.030117 May 12 21:24:09.997784 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1272/2479] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:09 2022] GET /compute/v2.1/servers/4d2c633e-b42f-4908-9fff-7cc274b0d6f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:24:13.360967 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:13.361597 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:13.367694 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:13.368150 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:13.368926 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:13.369401 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:13.397572 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Going to try to terminate instance {{(pid=129357) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 21:24:13.682934 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-f48db83d-1ce9-4c62-9631-10e32a205437 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 204 len: 0 microversion: 2.1 time: 0.325469 May 12 21:24:13.683520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1273/2480] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:24:13 2022] DELETE /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 21:24:13.692222 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-02bf2ff9-6977-424f-afc2-4821be4295fa req-575aec0a-1e53-48e6-96f4-251dd7430850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce1a77d-3764-4225-b0a4-45a1c5603cbf", "tag": "97554eef-a39b-482c-bf5d-d675c1b4e272"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:24:13.700609 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-02bf2ff9-6977-424f-afc2-4821be4295fa req-575aec0a-1e53-48e6-96f4-251dd7430850 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:13.701013 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-02bf2ff9-6977-424f-afc2-4821be4295fa req-575aec0a-1e53-48e6-96f4-251dd7430850 service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:13.712534 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-02bf2ff9-6977-424f-afc2-4821be4295fa req-575aec0a-1e53-48e6-96f4-251dd7430850 service nova] Creating event network-changed:97554eef-a39b-482c-bf5d-d675c1b4e272 for instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf on hv-cinder-81565 May 12 21:24:13.717388 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-02bf2ff9-6977-424f-afc2-4821be4295fa req-575aec0a-1e53-48e6-96f4-251dd7430850 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 May 12 21:24:13.719507 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1274/2481] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 21:24:13.722954 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:13.723658 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:13.729738 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:13.730197 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:13.732621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:13.732621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:13.871591 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:13.879765 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-a1a15df0-cf99-46a8-abbb-3f1777ef0505 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1577 microversion: 2.1 time: 0.160674 May 12 21:24:13.880340 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1275/2482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:13 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 21:24:14.897899 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:14.898529 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:14.905239 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:14.905730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:14.906502 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:14.906944 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:15.039066 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:15.046473 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-005da87a-b773-4c32-bfb0-cd1c1c000755 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1577 microversion: 2.1 time: 0.152492 May 12 21:24:15.047033 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1276/2483] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:14 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:24:15.688053 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [req-ca7ee7bb-53a5-4396-8381-0b305eda4402 req-38515634-6162-4d11-9743-435beb3b489a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce1a77d-3764-4225-b0a4-45a1c5603cbf", "name": "network-vif-deleted", "tag": "97554eef-a39b-482c-bf5d-d675c1b4e272"}]} {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 21:24:15.695885 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ca7ee7bb-53a5-4396-8381-0b305eda4402 req-38515634-6162-4d11-9743-435beb3b489a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:15.696324 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [req-ca7ee7bb-53a5-4396-8381-0b305eda4402 req-38515634-6162-4d11-9743-435beb3b489a service nova] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:15.707659 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.compute.server_external_events [req-ca7ee7bb-53a5-4396-8381-0b305eda4402 req-38515634-6162-4d11-9743-435beb3b489a service nova] Creating event network-vif-deleted:97554eef-a39b-482c-bf5d-d675c1b4e272 for instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf on hv-cinder-81565 May 12 21:24:15.712520 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [req-ca7ee7bb-53a5-4396-8381-0b305eda4402 req-38515634-6162-4d11-9743-435beb3b489a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028827 May 12 21:24:15.713095 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1277/2484] 10.222.0.59 () {64 vars in 1317 bytes} [Thu May 12 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 21:24:16.066481 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:16.067600 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:16.074400 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:16.075706 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:16.078657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:16.078657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:16.152621 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.policy [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce3a8645c67e438f8f4e6aa933daeb26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32287a21bed4346ae982132d4f29764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129357) authorize /opt/stack/nova/nova/policy.py:199}} May 12 21:24:16.164879 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-7fc15247-c2cf-45c6-a540-a8be11915c4a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 200 len: 1224 microversion: 2.1 time: 0.104345 May 12 21:24:16.165682 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1278/2485] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:16 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 21:24:17.182837 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:17.183476 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: 6ce1a77d-3764-4225-b0a4-45a1c5603cbf] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:17.189927 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.190373 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.191140 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.191570 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.204831 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] HTTP exception thrown: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Request method failure captured: May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf HTTP/1.1 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXlefkyF9inoZOKRAsjAkYt5XXwB6u8QW6niECP3Hg58CuSXufls4D32l03EF-fp9dfbbRjAXVHwdN1NSDFGUVxaLhIa3unO-wLuSX0UrEMsE5F1zmqNnkQicSFh0xCE1ZamDanmW6D13gGLXZ2FDffTqI-tJQHOx5XzKeBOr2bzKQo May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:24:17.206503 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d32287a21bed4346ae982132d4f29764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d32287a21bed4346ae982132d4f29764", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: ce3a8645c67e438f8f4e6aa933daeb26 May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. May 12 21:24:17.207859 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': '6ce1a77d-3764-4225-b0a4-45a1c5603cbf'} May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:24:17.208644 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. May 12 21:24:17.212890 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.214335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Returning 404 to user: Instance 6ce1a77d-3764-4225-b0a4-45a1c5603cbf could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:24:17.214335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-aceb2fa6-01e4-4475-9f3b-3f21e238779d tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf" status: 404 len: 111 microversion: 2.1 time: 0.029031 May 12 21:24:17.214335 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1279/2486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:17 2022] GET /compute/v2.1/servers/6ce1a77d-3764-4225-b0a4-45a1c5603cbf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:24:17.736776 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:17.737288 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:17.743257 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.743703 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.744485 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.744925 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.758253 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] HTTP exception thrown: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Request method failure captured: May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: DELETE /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b HTTP/1.1 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXlefkyF9inoZOKRAsjAkYt5XXwB6u8QW6niECP3Hg58CuSXufls4D32l03EF-fp9dfbbRjAXVHwdN1NSDFGUVxaLhIa3unO-wLuSX0UrEMsE5F1zmqNnkQicSFh0xCE1ZamDanmW6D13gGLXZ2FDffTqI-tJQHOx5XzKeBOr2bzKQo May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:24:17.759788 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d32287a21bed4346ae982132d4f29764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d32287a21bed4346ae982132d4f29764", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: ce3a8645c67e438f8f4e6aa933daeb26 May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.761096 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'd7f876a5-9a3a-4510-8c55-207ceab92f2b'} May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:24:17.761895 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.763612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.765175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Returning 404 to user: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:24:17.765175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-fa84cd47-7b05-4026-b092-1430fa3eebd1 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 404 len: 111 microversion: 2.1 time: 0.028357 May 12 21:24:17.765175 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1280/2487] 10.222.0.59 () {58 vars in 1238 bytes} [Thu May 12 21:24:17 2022] DELETE /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 21:24:17.770547 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:17.771165 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.compute.api [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [instance: d7f876a5-9a3a-4510-8c55-207ceab92f2b] Fetching instance by UUID {{(pid=129357) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 21:24:17.777248 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.777730 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.778598 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 21:24:17.780029 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG oslo_concurrency.lockutils [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Lock "f9fde6af-dc03-4b65-925d-792b71d3bae1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 21:24:17.795875 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.wsgi [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] HTTP exception thrown: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Request method failure captured: May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: request: GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b HTTP/1.1 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept: application/json May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Accept-Encoding: identity May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Connection: close May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Length: 0 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Content-Type: application/json May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Host: 10.222.0.59 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Openstack-System-Scope: None May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: User-Agent: python-urllib3/1.26.9 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Auth-Token: gAAAAABifXlefkyF9inoZOKRAsjAkYt5XXwB6u8QW6niECP3Hg58CuSXufls4D32l03EF-fp9dfbbRjAXVHwdN1NSDFGUVxaLhIa3unO-wLuSX0UrEMsE5F1zmqNnkQicSFh0xCE1ZamDanmW6D13gGLXZ2FDffTqI-tJQHOx5XzKeBOr2bzKQo May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Id: None May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Domain-Name: None May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Identity-Status: Confirmed May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Is-Admin-Project: True May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Id: default May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Domain-Name: Default May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Project-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Role: member,reader May 12 21:24:17.797461 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Roles: member,reader May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d32287a21bed4346ae982132d4f29764"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d32287a21bed4346ae982132d4f29764", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d32287a21bed4346ae982132d4f29764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}] May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Id: d32287a21bed4346ae982132d4f29764 May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-Tenant-Name: tempest-TestVolumeBootPattern-784875913 May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Id: default May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Domain-Name: Default May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Id: ce3a8645c67e438f8f4e6aa933daeb26 May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: X-User-Name: tempest-TestVolumeBootPattern-784875913-project May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: method: > May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: exception: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.798882 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: action_args: {'id': 'd7f876a5-9a3a-4510-8c55-207ceab92f2b'} May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 21:24:17.799612 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. May 12 21:24:17.800656 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR nova.api.openstack.wsgi May 12 21:24:17.801665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Returning 404 to user: Instance d7f876a5-9a3a-4510-8c55-207ceab92f2b could not be found. {{(pid=129357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 21:24:17.801665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-e0d6af8a-528e-46bf-a95c-9e4261d0537a tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b" status: 404 len: 111 microversion: 2.1 time: 0.032044 May 12 21:24:17.801665 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1281/2488] 10.222.0.59 () {58 vars in 1235 bytes} [Thu May 12 21:24:17 2022] GET /compute/v2.1/servers/d7f876a5-9a3a-4510-8c55-207ceab92f2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 21:24:19.348113 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: DEBUG nova.api.openstack.wsgi [None req-c6d704be-5ef4-46a0-9a9b-d6f8ed8ebf53 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] Calling method '.version_select at 0x7f4e62cd4940>' {{(pid=129357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 21:24:19.351380 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6d704be-5ef4-46a0-9a9b-d6f8ed8ebf53 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [5e1ef32d-c215-4205-8722-30a2d66c64ea] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 21:24:20.359219 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6d704be-5ef4-46a0-9a9b-d6f8ed8ebf53 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] [5e1ef32d-c215-4205-8722-30a2d66c64ea] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44114. May 12 21:24:20.438081 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO nova.api.openstack.requestlog [None req-c6d704be-5ef4-46a0-9a9b-d6f8ed8ebf53 tempest-TestVolumeBootPattern-784875913 tempest-TestVolumeBootPattern-784875913-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2084107512" status: 202 len: 0 microversion: 2.1 time: 1.093800 May 12 21:24:20.438657 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: [pid: 129357|app: 0|req: 1282/2489] 10.222.0.59 () {58 vars in 1262 bytes} [Thu May 12 21:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2084107512 => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 21:24:41.584211 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:24:41.584966 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:24:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:24:47.460988 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:24:47.461634 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:24:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:26:41.663569 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:26:41.664271 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:26:50.796227 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:26:50.796840 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! May 12 21:28:01.593027 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:28:01.593725 dv-cinder-815659-7-iscsi devstack@n-api.service[129357]: Thu May 12 21:28:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 21:28:07.469439 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 21:28:07.470239 dv-cinder-815659-7-iscsi devstack@n-api.service[129358]: Thu May 12 21:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!!